- Data Pipeline Development: Design, build, and maintain scalable data pipelines using PySpark and Python.
- AWS Cloud Integration: Work with AWS cloud services (S3, Lambda, Glue, EMR, Redshift) for data ingestion, processing, and storage.
- ETL Workflow Management: Implement and maintain ETL workflows using DBT and orchestration tools (e.g., Airflow).
- Data Warehousing: Design and manage data models in Snowflake, ensuring performance and reliability.
- SQL Optimization: Utilize SQL for querying and optimizing datasets across different databases.
- Data Integration: Integrate and manage data from MongoDB, Kafka, and other streaming or NoSQL sources.
- Collaboration & Support: Collaborate with data scientists, analysts, and other engineers to support advanced analytics and Machine Learning (ML) initiatives.
- Data Quality & Governance: Ensure data quality, lineage, and governance through best practices and tools.
- Strong programming skills in Python and PySpark.
- Hands-on experience with AWS data services (S3, Lambda, Glue, EMR, Redshift).
- Proficiency in SQL and experience with DBT for data transformation.
- Experience with Snowflake for data warehousing.
- Knowledge of MongoDB, Kafka, and data streaming concepts.
- Good understanding of data architecture, data modeling, and data governance.
- Familiarity with large-scale data platforms.
- Excellent problem-solving skills.
- Ability to work independently or as part of a team.
- Experience with CI/CD and DevOps practices in a data engineering environment (Plus).
- Proven hands-on experience working with large-scale data platforms.
- Strong background in Python, PySpark, AWS, and modern data warehousing tools such as Snowflake and DBT.
- Familiarity with NoSQL databases like MongoDB and real-time streaming platforms like Kafka.
-
Role Responsibilities: · Design, build, and maintain scalable data pipelines and ETL processes · Develop and ensure data quality across large datasets · Collaborate with cross-functional teams to meet business data needs · Implement data security and governance standards · Use cl ...
Hyderabad / Secunderabad, Telangana Full time1 day ago
-
We are seeking a skilled Data Engineer to join our dynamic team in India. The ideal candidate will have experience in building and managing data pipelines, ensuring data quality, and optimizing our data infrastructure to support analytics and business intelligence initiatives. · ...
Hyderabad / Secunderabad, Telangana ₹900,000 - ₹2,500,000 (INR) per year Full time1 day ago
-
Key Responsibilities · We are seeking a highly skilled and experienced Engineer to help us with the design and implementation of Future GCP Native Data Processing Framework. · The ideal candidate will have extensive experience building scalable data solutions, strong analytical s ...
Hyderabad / Secunderabad, Telangana ₹900,000 - ₹2,500,000 (INR) per year Full time1 day ago
-
Let's do this. Let's change the world. We are looking for highly motivated expert Data Engineer who can own the design & development of complex data pipelines, solutions and frameworks. The ideal candidate will be responsible to design, develop, and optimize data pipelines, data ...
Hyderabad / Secunderabad, Telangana ₹900,000 - ₹2,500,000 (INR) per year Full time1 day ago
-
Data Engineer Advanced Hyderabad, India Objectives of the role · • Design, build and maintain complex ELT jobs that deliver business value · • Translate high-level business requirements into technical specs · • Ingest data from disparate sources into the data lake and data war ...
Hyderabad / Secunderabad, Telangana ₹900,000 - ₹2,500,000 (INR) per year Full time5 days ago
-
Roles Responsibilities: · Design, develop, and maintain complex ETL/ELT data pipelines in Databricks using PySpark, Scala, and SQL to process large-scale datasets · Understand the biotech/pharma or related domains build highly efficient data pipelines to migrate and deploy comple ...
Hyderabad / Secunderabad, Telangana ₹900,000 - ₹2,500,000 (INR) per year Full time1 day ago
-
Seeking a skilled Data Engineer to work on cloud-based data pipelines and analytics platforms. The ideal candidate will have hands-on experience in PySpark and AWS, with proficiency in designing Data Lakes and working with modern data orchestration tools. · Data Engineer to work ...
Hyderabad / Secunderabad, Telangana ₹900,000 - ₹2,500,000 (INR) per year Full time1 day ago
-
Role Description: · Let's do this. Let's change the world. We are looking for a highly motivated expert Data Engineer who can own the design & development of complex data pipelines, solutions, and frameworks. The ideal candidate will be responsible to design, develop, and maintai ...
Hyderabad / Secunderabad, Telangana ₹900,000 - ₹2,500,000 (INR) per year Full time1 day ago
-
In this vital role, you will be responsible for designing, developing, and optimizing data pipelines, data integration frameworks, and metadata-driven architectures that enable seamless data access and analytics. This role prefers deep expertise in big data processing, distribute ...
Hyderabad / Secunderabad, Telangana ₹900,000 - ₹2,500,000 (INR) per year Full time1 day ago
-
Key Deliverables: · Build and maintain scalable data pipelines using Databricks and PySpark · Enable unified data access and governance across hybrid cloud systems · Implement robust data validation and metadata-driven frameworks · Drive automation and reusable data engineering c ...
Hyderabad / Secunderabad, Telangana ₹900,000 - ₹2,500,000 (INR) per year Full time1 day ago
-
Key Responsibilities: · Design, build, and maintain data pipelines (ETL/ELT) using BigQuery, Python, and SQL · Optimize data flow, automate processes, and scale infrastructure · Develop and manage workflows in Airflow/Cloud Composer and Ascend (or similar ETL tools) · Implement d ...
Hyderabad / Secunderabad, Telangana ₹900,000 - ₹2,500,000 (INR) per year Full time5 days ago
-
In this vital role, you will be a Data Engineer responsible for designing, building, and maintaining data solutions that provide actionable insights to drive business decisions. The ideal candidate will have strong technical skills, experience with big data technologies, and a de ...
Hyderabad / Secunderabad, Telangana ₹900,000 - ₹2,500,000 (INR) per year Full time1 day ago
-
Data Engineer - R&D Precision Medicine · What you will do · Let's do this. Let's change the world. In this vital role, you will be responsible for: · End-to-end development of an enterprise analytics and data mastering solution using Databricks and Power BI · Creating scalable, r ...
Hyderabad / Secunderabad, Telangana ₹900,000 - ₹2,500,000 (INR) per year Full time1 day ago
-
Let's do this. Let's change the world. In this vital role you will be responsible to design, develop, and optimize data pipelines, data integration frameworks, and metadata-driven architectures that enable seamless data access and analytics. This role prefers deep expertise in bi ...
Hyderabad / Secunderabad, Telangana ₹900,000 - ₹2,500,000 (INR) per year Full time1 day ago
-
We are seeking a skilled Data Engineer to join our team in India. The ideal candidate will be responsible for designing, building, and maintaining data pipelines that support our data-driven decision-making processes. You will work closely with cross-functional teams to ensure th ...
Hyderabad / Secunderabad, Telangana ₹900,000 - ₹2,500,000 (INR) per year Full time5 days ago
-
Expert Data Engineer · Role Description · Let's do this. Let's change the world. We are looking for a highly motivated Expert Data Engineer who can own the design and development of complex data pipelines, solutions, and frameworks. The ideal candidate will be responsible for des ...
Hyderabad / Secunderabad, Telangana ₹900,000 - ₹2,500,000 (INR) per year Full time1 day ago
-
Role Overview: · We are seeking a Data Engineer to support software development and data engineering efforts for target and biomarker discovery. This role plays a crucial part in building and maintaining robust data pipelines, enabling scientific research and data analytics for A ...
Hyderabad / Secunderabad, Telangana ₹900,000 - ₹2,500,000 (INR) per year Full time1 day ago
-
Roles and Responsibility · Design, develop, and implement data pipelines and architectures to support business intelligence and analytics. · Collaborate with cross-functional teams to identify and prioritize project requirements. · Develop and maintain large-scale data systems an ...
Hyderabad / Secunderabad, Telangana ₹900,000 - ₹2,500,000 (INR) per year Full time1 day ago
-
Big Data Engineer / Infrastructure Developer · Liaising with coworkers and clients to elucidate the requirements for each task · Conceptualizing and generating infrastructure that allows big data to be accessed and analyzed · Reformulating existing frameworks to optimize their fu ...
Hyderabad / Secunderabad, Telangana ₹900,000 - ₹2,500,000 (INR) per year Full time1 day ago
-
Key Deliverables: · Build and maintain scalable ETL pipelines for structured and unstructured datasets · Implement end-to-end data architecture including modeling, governance, and performance tuning · Support web application backend with integrated data pipelines and real-time pr ...
Hyderabad / Secunderabad, Telangana ₹900,000 - ₹2,500,000 (INR) per year Full time1 day ago
Data Engineer - Hyderabad / Secunderabad, Telangana - Virtusa
Description
Job Title: Senior Data Engineer
Location
Hyderabad, Telangana, India
Key Responsibilities
As a Senior Data Engineer, you will:
Mandatory Skills & Experience
Essential Professional Skills
Qualifications
-
Senior Data Engineer
Full time Amgen Technology Private Limited- Hyderabad / Secunderabad, Telangana
-
Data Engineer
Full time Virtusa- Hyderabad / Secunderabad, Telangana
-
Data Engineer
Full time Tech Stalwart Solution- Hyderabad / Secunderabad, Telangana
-
Data Engineer
Full time Amgen Technology Private Limited- Hyderabad / Secunderabad, Telangana
-
Data Engineer
Full time confidential- Hyderabad / Secunderabad, Telangana
-
Data Engineer
Full time Amgen Technology Private Limited- Hyderabad / Secunderabad, Telangana
-
Data Engineer
Full time Virtusa- Hyderabad / Secunderabad, Telangana
-
Data Engineer
Full time Amgen Technology Private Limited- Hyderabad / Secunderabad, Telangana
-
Data Engineer
Full time Amgen Technology Private Limited- Hyderabad / Secunderabad, Telangana
-
Data Engineer
Full time Amgen Technology Private Limited- Hyderabad / Secunderabad, Telangana
-
Data Engineer
Full time confidential- Hyderabad / Secunderabad, Telangana
-
Data Engineer
Full time Amgen Technology Private Limited- Hyderabad / Secunderabad, Telangana
-
Data Engineer
Full time Amgen Technology Private Limited- Hyderabad / Secunderabad, Telangana
-
Data Engineer
Full time Amgen Technology Private Limited- Hyderabad / Secunderabad, Telangana
-
Data Engineer
Full time confidential- Hyderabad / Secunderabad, Telangana
-
Data Engineer
Full time Amgen Technology Private Limited- Hyderabad / Secunderabad, Telangana
-
Data Engineer
Full time Amgen Technology Private Limited- Hyderabad / Secunderabad, Telangana
-
DATA Engineer
Full time IDESLABS- Hyderabad / Secunderabad, Telangana
-
Data Engineer
Full time Verified Group Bounteous X Accolite- Hyderabad / Secunderabad, Telangana
-
Data Engineer
Full time Amgen Technology Private Limited- Hyderabad / Secunderabad, Telangana