- Write ingestion scripts (batch & stream) to migrate data from on-prem to S3.
- Translate existing HiveQL into SparkSQL/PySpark jobs.
- Configure MWAA DAGs to orchestrate job dependencies.
- Build Iceberg tables with appropriate partitioning and metadata handling.
- Validate job outputs and write unit tests.
- 35 years in data engineering, with strong exposure to AWS.
- Experience in EMR (Spark), S3, PySpark, SQL.
- Working knowledge of Cloudera/HDFS and legacy Hadoop pipelines.
- Prior experience with data lake/lakehouse implementations is a plus
- AWS Developer
-
Role Responsibilities: · Design, build, and maintain scalable data pipelines and ETL processes · Develop and ensure data quality across large datasets · Collaborate with cross-functional teams to meet business data needs · Implement data security and governance standards · Use cl ...
Hyderabad / Secunderabad, Telangana Full time13 hours ago
-
Roles Responsibilities: · Design, develop, and maintain complex ETL/ELT data pipelines in Databricks using PySpark, Scala, and SQL to process large-scale datasets · Understand the biotech/pharma or related domains build highly efficient data pipelines to migrate and deploy comple ...
Hyderabad / Secunderabad, Telangana ₹900,000 - ₹2,500,000 (INR) per year Full time13 hours ago
-
Big Data Engineer / Infrastructure Developer · Liaising with coworkers and clients to elucidate the requirements for each task · Conceptualizing and generating infrastructure that allows big data to be accessed and analyzed · Reformulating existing frameworks to optimize their fu ...
Hyderabad / Secunderabad, Telangana ₹900,000 - ₹2,500,000 (INR) per year Full time13 hours ago
-
Key Responsibilities · Design, build, and maintain scalable and reliable data pipelines for batch and real-time use cases. · Work on distributed systems to support large-scale data processing. · Develop, optimize, and manage streaming data workflows ensuring high throughput and l ...
Hyderabad / Secunderabad, Telangana ₹900,000 - ₹2,500,000 (INR) per year Full time13 hours ago
-
Seeking a skilled Data Engineer to work on cloud-based data pipelines and analytics platforms. The ideal candidate will have hands-on experience in PySpark and AWS, with proficiency in designing Data Lakes and working with modern data orchestration tools. · Data Engineer to work ...
Hyderabad / Secunderabad, Telangana ₹900,000 - ₹2,500,000 (INR) per year Full time13 hours ago
-
Role- Data Engineer · Job Description · Desired Competencies (Technical/Behavioral Competency) · Python with Pandas, Numpy · SQL · Responsibility of / Expectations from the Role · Python with Pandas, Numpy · Good SQL exp · Good Communication skills · Good stakeholder management e ...
Hyderabad / Secunderabad, Telangana $1,000,000 - $1,200,000 (USD) per year Full time4 days ago
-
Roles & Responsibilities: · Develop interactive and user-friendly dashboards and visualizations using Spotfire, Power BI, and Tableau. · Create dynamic reports and visualizations to support data-driven decision-making. · Analyze complex datasets and transform them into meaningful ...
Hyderabad / Secunderabad, Telangana ₹900,000 - ₹2,500,000 (INR) per year Full time13 hours ago
-
Design and build scalable enterprise analytics solutions using Databricks, Power BI, and other modern data tools. · Leverage data virtualization, ETL, and semantic layers to balance need for unification, performance, and data transformation with goal to reduce data proliferation ...
Hyderabad / Secunderabad, Telangana ₹900,000 - ₹2,500,000 (INR) per year Full time13 hours ago
-
What you will do · In this vital role, you will be responsible for the end-to-end development of an enterprise analytics and data mastering solution using Databricks and Power BI. This role requires expertise in both data architecture and analytics, with the ability to create sca ...
Hyderabad / Secunderabad, Telangana ₹900,000 - ₹2,500,000 (INR) per year Full time13 hours ago
-
Roles & Responsibilities: · Design, develop, and maintain data solutions for data generation, collection, and processing · Be a key team member that assists in design and development of the data pipeline · Create data pipelines and ensure data quality by implementing ETL processe ...
Hyderabad / Secunderabad, Telangana ₹900,000 - ₹2,500,000 (INR) per year Full time13 hours ago
-
Design, develop, and maintain complex ETL/ELT data pipelines in Databricks using PySpark, Scala, and SQL to process large-scale datasets · Understand the biotech/pharma or related domains & build highly efficient data pipelines to migrate and deploy complex data across systems · ...
Hyderabad / Secunderabad, Telangana ₹900,000 - ₹2,500,000 (INR) per year Full time13 hours ago
-
Expert Data Engineer · Role Description · Let's do this. Let's change the world. We are looking for a highly motivated Expert Data Engineer who can own the design and development of complex data pipelines, solutions, and frameworks. The ideal candidate will be responsible for des ...
Hyderabad / Secunderabad, Telangana ₹900,000 - ₹2,500,000 (INR) per year Full time13 hours ago
-
Role Overview: · We are seeking a Data Engineer to support software development and data engineering efforts for target and biomarker discovery. This role plays a crucial part in building and maintaining robust data pipelines, enabling scientific research and data analytics for A ...
Hyderabad / Secunderabad, Telangana ₹900,000 - ₹2,500,000 (INR) per year Full time13 hours ago
-
Data Engineer - R&D Precision Medicine · What you will do · Let's do this. Let's change the world. In this vital role, you will be responsible for: · End-to-end development of an enterprise analytics and data mastering solution using Databricks and Power BI · Creating scalable, r ...
Hyderabad / Secunderabad, Telangana ₹900,000 - ₹2,500,000 (INR) per year Full time13 hours ago
-
Key Responsibilities:Design and implement data models and pipelines using VaultSpeed to automate Data Vault architecture. · Write and optimize complex SQL queries for data extraction, transformation, and loading (ETL/ELT). · Work closely with data architects, analysts, and busine ...
Hyderabad / Secunderabad, Telangana ₹900,000 - ₹2,500,000 (INR) per year Full time4 days ago
-
Roles & Responsibilities: · Function as a Digital Technology Data and Analytics Data Engineer within a Scaled Agile Framework (SAFe) product team · As member of Global Medical Data and Analytics Product team, ensure progress to business needs in a cost effective, compliant, relia ...
Hyderabad / Secunderabad, Telangana ₹900,000 - ₹2,500,000 (INR) per year Full time13 hours ago
-
Let's do this. Let's change the world. We are looking for highly motivated expert Data Engineer who can own the design & development of complex data pipelines, solutions and frameworks. The ideal candidate will be responsible to design, develop, and optimize data pipelines, data ...
Hyderabad / Secunderabad, Telangana ₹900,000 - ₹2,500,000 (INR) per year Full time13 hours ago
-
Let's do this. Let's change the world. In this vital role you will be responsible to design, develop, and optimize data pipelines, data integration frameworks, and metadata-driven architectures that enable seamless data access and analytics. This role prefers deep expertise in bi ...
Hyderabad / Secunderabad, Telangana ₹900,000 - ₹2,500,000 (INR) per year Full time13 hours ago
-
Key Deliverables: · Build and maintain scalable ETL pipelines for structured and unstructured datasets · Implement end-to-end data architecture including modeling, governance, and performance tuning · Support web application backend with integrated data pipelines and real-time pr ...
Hyderabad / Secunderabad, Telangana ₹900,000 - ₹2,500,000 (INR) per year Full time13 hours ago
-
Job Title: Senior Data Engineer · Location · Hyderabad, Telangana, India · Key Responsibilities · As a Senior Data Engineer, you will: · Data Pipeline Development: Design, build, and maintain scalable data pipelines using PySpark and Python. · AWS Cloud Integration: Work with AWS ...
Hyderabad / Secunderabad, Telangana ₹900,000 - ₹2,500,000 (INR) per year Full time13 hours ago
-
Role Description: · Let's do this. Let's change the world. We are looking for a highly motivated expert Data Engineer who can own the design & development of complex data pipelines, solutions, and frameworks. The ideal candidate will be responsible to design, develop, and maintai ...
Hyderabad / Secunderabad, Telangana ₹900,000 - ₹2,500,000 (INR) per year Full time13 hours ago
Aws Data Engineer - Hyderabad / Secunderabad, Telangana - confidential
Description
As part of the offshore development team, the AWS Developers will be responsible for implementing ingestion and transformation pipelines using PySpark, orchestrating jobs via MWAA, and converting legacy Cloudera jobs to AWS-native services.
Key Responsibilities:
Required Skills:
Mandatory Skills
-
Senior Data Engineer
Full time Amgen Technology Private Limited- Hyderabad / Secunderabad, Telangana
-
Data Engineer
Full time Amgen Technology Private Limited- Hyderabad / Secunderabad, Telangana
-
Data Engineer
Full time Verified Group Bounteous X Accolite- Hyderabad / Secunderabad, Telangana
-
Data Engineer
Full time Infec Services Private Limited- Hyderabad / Secunderabad, Telangana
-
Data Engineer
Full time Virtusa- Hyderabad / Secunderabad, Telangana
-
Data Engineer
Full time confidential- Hyderabad / Secunderabad, Telangana
-
Data Engineer
Full time Amgen Technology Private Limited- Hyderabad / Secunderabad, Telangana
-
Data Engineer
Full time Amgen Technology Private Limited- Hyderabad / Secunderabad, Telangana
-
Data Engineer
Full time Amgen Technology Private Limited- Hyderabad / Secunderabad, Telangana
-
Data Engineer
Full time Amgen Technology Private Limited- Hyderabad / Secunderabad, Telangana
-
Data Engineer
Full time Amgen Technology Private Limited- Hyderabad / Secunderabad, Telangana
-
Data Engineer
Full time Amgen Technology Private Limited- Hyderabad / Secunderabad, Telangana
-
Data Engineer
Full time Amgen Technology Private Limited- Hyderabad / Secunderabad, Telangana
-
Data Engineer
Full time Amgen Technology Private Limited- Hyderabad / Secunderabad, Telangana
-
Data Engineer
Full time confidential- Hyderabad / Secunderabad, Telangana
-
Data Engineer
Full time Amgen Technology Private Limited- Hyderabad / Secunderabad, Telangana
-
Data Engineer
Full time Amgen Technology Private Limited- Hyderabad / Secunderabad, Telangana
-
Data Engineer
Full time Amgen Technology Private Limited- Hyderabad / Secunderabad, Telangana
-
Data Engineer
Full time Amgen Technology Private Limited- Hyderabad / Secunderabad, Telangana
-
Data Engineer
Full time Virtusa- Hyderabad / Secunderabad, Telangana
-
Data Engineer
Full time Amgen Technology Private Limited- Hyderabad / Secunderabad, Telangana