- Data Ingestion & ETL: Design, develop, and maintain scalable ETL/ELT pipelines to ingest data from diverse enterprise sources, including SQL databases, Oracle ERPs, and flat files (FTP/SFTP).
- Pipeline Orchestration: Build and manage data workflows using tools like Apache Airflow or Prefect to ensure timely, reliable data delivery to the AI/ML team.
- Schema Design: Collaborate with the Lead AI Engineer to define and implement data schemas that optimize the performance of RAG (Retrieval-Augmented Generation) pipelines.
- Database Management: Optimize and manage both relational (PostgreSQL/MySQL) and non-relational storage solutions, specifically Vector databases like Pinecone or Weaviate.
- Data Cleaning & Validation: Implement automated data validation and cleaning scripts to ensure that the "intelligence" layer receives high-quality, audit-ready data.
- API Development: Build and maintain internal APIs and connectors that facilitate seamless communication between the data warehouse
- Security & Compliance: Ensure all data pipelines adhere to strict enterprise security protocols, including encryption at rest and in transit, to protect sensitive client information.
- Collaboration: Work closely with the Full Stack Lead and AI Engineers to synchronize data ingestion logic with application requirements and AI "thinking" processes.
- Education: Bachelor's or Master's degree in Data Science, Computer Science, Information Technology, or a related quantitative field.
- Technical Proficiency: Advanced expertise in Python and SQL. Deep understanding of database internals and query optimization.
- Enterprise Integration: Proven experience in connecting to and extracting data from enterprise-grade systems like Oracle, SAP, or Microsoft Dynamics.
- Data Engineering Tools: Hands-on experience with modern data stack tools (e.g., dbt, Airflow, Snowflake, or Databricks).
- Cloud Infrastructure: Strong familiarity with AWS (S3, Redshift, Glue) or Azure data services.
- Big Data Frameworks: (Optional but preferred) Knowledge of Spark or Flink for processing large-scale environmental datasets.
- Version Control: Proficiency in Git and experience working in an Agile development environment.
- Problem Solving: A systematic approach to debugging complex data flows and a commitment to data accuracy and reliability.
-
Data Engineers design and build data systems and pipelines. · Responsibilities include developing data processing workflows, optimizing data storage, and ensuring data accuracy.You will collaborate with data scientists and analysts to meet data requirements. · Strong experience i ...
Noida, Uttar Pradesh1 week ago
-
Data Engineers design and build data systems and pipelines. · Developing data processing workflowsOptimizing data storageEnsuring data accuracy, 'valid_job':1} ) let json = { 'summary': '', 'searchable_title': '', 'remuneration_min' :'', 'remuneration_max' : ' ...
Noida1 month ago
-
Company Overview · ALIQAN Technologies is a leading IT services and consulting firm based in New Delhi, offering clients innovative design, software, and web development solutions all in one place. Our comprehensive approach aims to deliver pure satisfaction and convenience for o ...
Noida ₹900,000 - ₹2,500,000 (INR) per year Remote1 week ago
-
+Job summary · We are seeking a skilled and detail-oriented Data Engineer (Apache Flume/Kafka) to join our team. · Qualifications3+ years of experience in data engineering or ETL development. · + ...
Greater Noida, Hyderabad, Pune3 weeks ago
-
We are seeking a highly skilled · Data Engineer with strong Python expertise and hands-on experience in AI-driven data engineering.You will be part of agile pods working on cutting-edge AI Search Agent and Sales Agent solutions. · ...
Greater Noida4 weeks ago
-
AWS Cloud Data Engineering for one of our client MNC · Location: Remote · Job type: Contractual for 6months · Experience : 5+ years · Mandatory Skill: Apache - Nifi , Apache Airflow , Power BI , Glue , Step Function , Lambda · Key Responsibilities · Design, develop, and deploy d ...
Noida ₹900,000 - ₹2,500,000 (INR) per year4 days ago
-
Data Engineer to design and build robust scalable high-quality · data pipelines that support analytics and reporting needs.Data integrity privacy compliance through governance practices secure schema design. · Implement data masking access controls metadata management for sensit ...
Noida1 month ago
-
We are looking for a skilled Data Engineer with experience in building scalable data ingestion frameworks, data pipelines, and real-time processing systems. · ...
Noida1 month ago
-
We're looking for an experienced Data Engineer who's passionate about building scalable, high-performance data solutions. · Skill Requirements: Python Software Engineering Best Practices SQL Database Concepts Data Processing Frameworks (Pandas) Cloud Platforms (GCP preferred) · ...
Noida, Uttar Pradesh1 month ago
-
· Position Overview · We are looking for an experienced Data Engineer to join our dynamic team. If you are passionate about building scalable software solutions, and work collaboratively with cross-functional teams to define requirements and deliver solutions we would love to h ...
Noida, Uttar Pradesh ₹900,000 - ₹2,500,000 (INR) per year10 hours ago
-
Data engineering & architecture including designing, developing and maintaining scalable data pipelines. · ...
Noida1 month ago
-
We are seeking an experienced Data Engineer to design, build, and optimize scalable data architectures and pipelines that power business insights across our EdTech platform. · 4–9 years of hands-on experience in data architecture, engineering, or related roles. · Strong expertise ...
Noida, Uttar Pradesh1 month ago
-
Data engineering specialist with hands-on expertise in PySpark, Databricks and Delta Lake. · We are looking for an experienced Data Engineering Specialist with hands-on expertise in PySpark, Databricks and Delta Lake. ...
Noida, Uttar Pradesh1 month ago
-
We are seeking skilled Data Engineers to design build and optimize large scale analytics data structures for US enterprise clients. · Design/develop large scale data structures for analytics and reporting · Implement ETL/ELT pipelines using SQL Python Spark on AWS Redshift · ...
Noida, Uttar Pradesh1 month ago
-
We are looking for a motivated Data Engineer with 2-6 years of experience to join our dynamic team. · Design, build, and maintain data pipelines and ETL/ELT workflows primarily using Azure Data Factory, Azure Databricks, Azure SQL, and Data Lake Storage. · ...
Noida, Uttar Pradesh2 weeks ago
-
We are seeking a Data Engineer with strong hands-on experience in cloud-based large-scale data platforms. This role requires close collaboration with data scientists analysts and business stakeholders to deliver reliable scalable and governed data solutions. · 6 years of hands-on ...
Noida1 month ago
-
We are hiring a Data Engineer for a leading healthcare SaaS company. · The role focuses on building and maintaining scalable data pipelines and backend data systems. · ...
Noida1 month ago
-
We are looking for a Sr. Data Engineer with hands-on experience in Microsoft Fabric , Fabric Copilot , and Power BI , capable of working with multiple data sources. · ...
Noida, Uttar Pradesh1 month ago
-
The Lead Data Engineer is a strategic and technical leadership role responsible for architecting scaling and evolving enterprise-grade data platforms that enable advanced analytics AI/ML and data-driven decision-making.This position combines hands-on engineering expertise with ar ...
Noida1 month ago
-
Design and develop data pipelines using Python and SQL to extract insights from large datasets. · ...
Noida1 month ago
Data Engineer - Noida - EcoRatings
Description
About this Job
EcoRatings is seeking a robust and detail-oriented Data Engineer to build the critical data pipelines that ingest massive datasets from enterprise systems into our proprietary AI ecosystem.
As a core member of the Intelligence & Data track, you will bridge the gap between raw enterprise data (Oracle, SQL, FTP) and our generative AI models. This role is ideal for an engineer who thrives on solving complex data ingestion challenges and ensuring data integrity in high-stakes environments.
Responsibilities
Qualifications
-
Data Engineer-Data engineer-Engineering
Only for registered members Noida, Uttar Pradesh
-
Data Engineer-Data engineer-Engineering
Only for registered members Noida
-
Data engineer
Remote Only for registered members Noida
-
Data Engineer
Only for registered members Greater Noida, Hyderabad, Pune
-
Data Engineer
Only for registered members Greater Noida
-
Data Engineer
Only for registered members Noida
-
Data Engineer
Only for registered members Noida
-
Data Engineer
Only for registered members Noida
-
Data Engineer
Only for registered members Noida, Uttar Pradesh
-
Data Engineer
Only for registered members Noida, Uttar Pradesh
-
Data Engineering
Only for registered members Noida
-
Data Engineer
Only for registered members Noida, Uttar Pradesh
-
Data Engineer
Only for registered members Noida, Uttar Pradesh
-
Data Engineer
Only for registered members Noida, Uttar Pradesh
-
Data Engineer
Only for registered members Noida, Uttar Pradesh
-
Data Engineer
Only for registered members Noida
-
Data Engineer
Only for registered members Noida
-
Data Engineer
Only for registered members Noida, Uttar Pradesh
-
Data Engineer
Only for registered members Noida
-
Data Engineer
Only for registered members Noida