- Design, build, and maintain ETL/ELT pipelines in Azure Data Factory and equivalent tool across Bronze → Silver → Gold layers/Medallion Architecture.
- Implement Delta Lake best practices (ACID, schema evolution, MERGE/upsert, time travel, Z-ORDER).
- Write performant PySpark and SQL; tune jobs (partitioning, caching, join strategies).
- Create reusable components; manage code in Git; contribute to CI/CD pipelines (Azure DevOps/GitHub Actions/Jenkins).
- Apply data quality checks (Great Expectations or custom validations), monitoring, drift detection, and alerting.
- Model data for analytics (star/dimensional); publish to Synapse/Snowflake/SQL Server.
- Uphold governance and security (Purview/Unity Catalog lineage, RBAC, tagging, encryption, PII handling).
- Author documentation/runbooks; support production incidents and root-cause analysis; suggest cost/performance improvements.
- Handson experience building production pipelines with Azure Data Factory or equivalent and industry standard data analytics platform for building, deploying, storing, sharing and maintaining enterprise grade data (PySpark/SQL).
- Working knowledge of Medallion Architecture and Delta Lake (schema evolution, ACID).
- Power BI exposure for publishing curated tables and building operational KPIs.
- Strong Python (pandas/PySpark) and SQL.
- Practical Git workflow; experience integrating pipelines into CI/CD (Azure DevOps/GitHub Actions/Jenkins).
- Familiarity with packaging reusable code (e.g., Python wheels) and configuration-driven jobs.
- Solid grasp of dimensional modeling/star schemas; experience with Synapse, Snowflake, or SQL Server.
- Implemented validation checks and alerts; exposure to drift detection and pipeline observability.
- ADLS Gen2, Key Vault, ADF basics (linked services, datasets, triggers), environment promotion.
- Experience with metadata/lineage (Purview/Unity Catalog), RBAC, secrets management, and secure data sharing.
- Understanding of PII/PHI handling and encryption at rest/in transit.
- Clear communication, documentation discipline, Agile ways of working, and code reviews.
- Machine Learning: Deep understanding of supervised, unsupervised, and reinforcement learning, model evaluation, and feature engineering.
- Programming: Expert in Python (NumPy, Pandas, scikit-learn, etc.); R exposure acceptable.
- Drift Detection & Monitoring: Hands-on experience with model drift detection, monitoring, and automated alerts.
- Good understanding of MLOps pipelines using Azure ML, MLflow, and CI/CD/CT
- Databricks Asset Bundles (DAB) for environment promotion/infra-as-code style deployments.
- Streaming/real-time: Kafka/Event Hubs; CDC tools (e.g., Debezium, ADF/Synapse CDC).
- MLOps touchpoints: MLflow tracking/registry, feature tables, basic model-inference pipelines.
- DataOps practices: automated testing, data contracts, lineage-aware deployments, cost optimization on Azure.
- Certifications: Microsoft Certified — Azure Data Engineer Associate (DP-203) or equivalent.
- 10+ years of professional experience in data engineering (or equivalent project depth).
- Bachelor's/Master's in CS/IT/Engineering or related field (or equivalent practical experience).
-
Data Warehouse Engineer to help design build and scale our data platform in a fast-paced FinTech environment. · Design build and maintain scalable data warehouses and data lakes on AWS · Develop and maintain data pipelines to ingest data from APIs and internal systems · ...
Ahmedabad1 month ago
-
We are looking for a skilled Data Engineer / ETL Developer with hands-on experience in Matillion, Snowflake, SQL, and AWS S3 to design build and optimize data pipelines The ideal candidate will work closely with cross-functional teams in an agile environment to deliver high-quali ...
Ahmedabad, Delhi, Mumbai, NCR1 month ago
-
The impact you will have: · Guide Big Data Transformations: Implementation of comprehensive big data projects, including the development and deployment of innovative big data and AI applications. · Ensure Best Practices: Guarantee that Databricks best practices are applied t ...
Ahmedabad ₹900,000 - ₹2,500,000 (INR) per year2 weeks ago
-
Job Profile: Data Engineer · Experience: 4-5 Years · Who we are: Innovatics is a place where innovation blends with analytics. · We, Innovatics, take pride in knowing the notion of bleeding-edge technologies, strategic business moves, and radiant business transformation. We deliv ...
Ahmedabad, Gujarat ₹900,000 - ₹2,500,000 (INR) per year5 days ago
-
Data EngineerRole - Data Engineer · Bachelor s degree in Computer Science, Data Science, or a related field. · ...
Ahmedabad1 month ago
-
In an era where Data is the new Oil our firm acts as the refinery We don't just move bytes we engineer intelligence As a Data Engineer you are joining a high-performance consulting squad dedicated to transforming messy fragmented data into high-fidelity fact-based assets · ...
Ahmedabad, Gujarat1 month ago
-
We are looking for a skilled Web Application Developer with strong Data Engineering expertise to build scalable web applications and manage Azure-based data pipelines. · 8+ years of overall experience. · Strong in JavaScript, HTML, CSS + one JS framework. · ...
Ahmedabad2 months ago
-
Position: · Data EngineerJob Description: · Key Responsibilities: · - Design, develop, and maintain data pipelines and architectures. · - Implement and optimize data integration and transformation processes. · - Collaborate with data scientists and machine learning engineers to i ...
Ahmedabad, India $60,000 - $120,000 (USD) per year1 week ago
-
Job Title: Data Engineer · (3-5 years experience) · Job Summary · We are seeking a highly skilled Data Engineer with 3-5 years of experience to join our dynamic team. The ideal candidate will have a strong background in both on-premises data engineering technologies and Cloud ser ...
Ahmedabad, Gujarat ₹900,000 - ₹2,500,000 (INR) per year2 days ago
-
Job Overview: · We are looking for a skilled and experienced Data Engineer to join our team. The ideal candidate will have a strong background in Azure Data Factory, Databricks, Pyspark, Python, Azure SQL and other Azure cloud services, and will be responsible for building and ma ...
Ahmedabad ₹900,000 - ₹2,500,000 (INR) per year2 weeks ago
-
· About Us · Zuru Tech is digitalizing the construction process of buildings all around the world. We have a multi-national team developing the world's first digital building fabrication platform, you design, we build it · We at ZURU develop the Zuru Home app, a BIM software ...
India, Ahmedabad ₹8,000 - ₹16,000 (INR) per year1 week ago
-
Job Title: Sr. Data Engineer (Azure) · Location: Ahmedabad, Gujarat · Job Type: Full Time · Experience: 4+ years · Department: Data Engineering · About Simform: · Simform is a premier digital engineering company specializing in Cloud, Data, AI/ML, and Experience Engineering to cr ...
Ahmedabad ₹900,000 - ₹2,500,000 (INR) per year4 days ago
-
Develop and maintain data ingestion and transformation pipelines Support ETL/ELT workflows across batch and/or streaming use cases Contribute to layered data architecture implementations (e.g., Bronze/Silver/Gold or equivalent Assist in building transformation models and maintain ...
India, Ahmedabad2 weeks ago
-
We don't just move bytes; we engineer intelligence. As a Data Engineer you are joining high-performance consulting squad dedicated to transforming messy fragmented data into fact-based assets. · You will architect ELT pipelines empowering global organizations to make multi-millio ...
Ahmedabad, Gujarat1 month ago
-
Design scalable ETL/ELT pipelines and data models, ensure data quality, security and performance. · ...
Ahmedabad2 months ago
-
We are seeking an experienced Data Engineering & Schema Steward (Metadata Owner) to drive enterprise metadata governance while supporting structured data ingestion into a centralized Data Lake. · - High-ownership role with direct impact on enterprise data quality and governance ...
Gujarat1 month ago
-
· About Us · Zuru Tech is digitalizing the construction process of buildings all around the world. We have a multi-national team developing the world's first digital building fabrication platform, you design, we build it · We at ZURU develop the Zuru Home app, a BIM software ...
India, Ahmedabad ₹8,000 - ₹16,000 (INR) per year1 week ago
-
Drive products through the development lifecycle, · from proof of concept to production-ready systems. · ...
Ahmedabad1 month ago
-
We are seeking a client-facing Data Engineer to deliver end-to-end healthcare data solutions across EHR platforms. This role involves designing and maintaining reliable data pipelines, developing and optimizing SQL and ETL workflows, and transforming data using SQL, Python, or Ja ...
Ahmedabad ₹900,000 - ₹2,500,000 (INR) per year1 week ago
-
We are looking for a Data Engineer to design and develop complex data pipelines, ETL/ELT workflows, and data models on platforms such as Snowflake, Databricks, Azure Synapse, Redshift, BigQuery etc. · Architect and develop complex data pipelines · Buil scalable data transformatio ...
India, Ahmedabad2 weeks ago
-
Position: Data Engineer (Snowflake, DBT/ Matillion), Ahmedabad · Department: Information Technology | Role: Full-time | Experience: 3 to 5 Years | Number of Positions: 2 | Location: Ahmedabad · Skillset: · Snowflake, DBT/Matillion, Azure Cloud, Data Factory, Data Bricks, Data War ...
Ahmedabad, Gujarat, India ₹900,000 - ₹2,500,000 (INR) per year1 week ago
Lead Data Engineer - Ahmedabad - eInfochips (An Arrow Company)
&v=024){kind=logo}
Description
Role: Lead Data Engineer
Years of Experience: Years
Location: Ahmedabad
Notice Period: Immediate to 45 Days Max
Key Skill: Azure, ADF, DataBricks, PySpark, Python, SQL, PowerBI
Job Description:
Tech Lead with core experience in Data Engineering and have good understanding of Machine Learning. Build and operate scalable, reliable data pipelines on Azure. Develop batch and streaming ingestion, transform data using industry standard data analytics and AI platform (PySpark/SQL), ADF/Snowflake or equivalent, enforce data quality, and publish curated datasets for analytics and ML. Good understanding of supervised, unsupervised learning, model evaluation, and feature engineering
Key Responsibilities:
Must-Have (Mandatory)
Data Engineering & Pipelines
Programming & Automation
Data Modeling & Warehousing
Data Quality & Monitoring
Cloud Platforms (Azure preferred)
Data Governance & Security
Collaboration
Good-to-Have:
Qualifications:
-
Data Engineer
Only for registered members Ahmedabad
-
Data Engineer
Only for registered members Ahmedabad, Delhi, Mumbai, NCR
-
Data Engineer
Only for registered members Ahmedabad
-
Data Engineer
Only for registered members Ahmedabad, Gujarat
-
Data Engineer
Only for registered members Ahmedabad
-
Data Engineer
Only for registered members Ahmedabad, Gujarat
-
Data Engineer
Only for registered members Ahmedabad
-
Data Engineer
Only for registered members Ahmedabad, India
-
Data Engineer
Only for registered members Ahmedabad, Gujarat
-
Data Engineer
Only for registered members Ahmedabad
-
Data Engineer
Only for registered members India, Ahmedabad
-
Data Engineer
Simform- Ahmedabad
-
Data Engineer
Only for registered members India, Ahmedabad
-
Data Engineer
Only for registered members Ahmedabad, Gujarat
-
Data Engineer
Only for registered members Ahmedabad
-
Data Engineering
Only for registered members Gujarat
-
Data Engineer
Only for registered members India, Ahmedabad
-
Data Engineer
Only for registered members Ahmedabad
-
Data Engineer
Only for registered members Ahmedabad
-
Data Engineer
Only for registered members India, Ahmedabad
-
Data Engineer
Only for registered members Ahmedabad, Gujarat, India