Principal Consultant, Databricks, Pyspark, AWS - Hyderabad / Secunderabad, Telangana - Genpact

    Genpact
    Genpact Hyderabad / Secunderabad, Telangana

    1 day ago

    Full time Sales
    Description
    Ready to build the future with AI
    At Genpact, we don't just keep up with technology-we set the pace. AI and digital innovation are redefining industries, and we're leading the charge.

    Genpact's AI Gigafactory, our industry-first accelerator, is an example of how we're scaling advanced technology solutions to help global enterprises work smarter, grow faster, and transform at scale.

    From large-scale models to agentic AI, our breakthrough solutions tackle companies' most complex challenges.

    If you thrive in a fast-moving, innovation-driven environment, love building and deploying cutting-edge AI solutions, and want to push the boundaries of what's possible, this is your moment.

    Genpact (


    NYSE:
    G) is an advanced technology services and solutions company that delivers lasting value for leading enterprises globally.

    Through our deep business knowledge, operational excellence, and cutting-edge solutions - we help companies across industries get ahead and stay ahead.

    Powered by curiosity, courage, and innovation, our teams implement data, technology, and AI to create tomorrow, today. Get to know us at and on LinkedIn, X, YouTube, and Facebook.
    Inviting applications for the role of Principal Consultant, Databricks, Pyspark, AWS

    In this role, the Databricks Developer is responsible for solving the real world cutting edge problem to meet both functional and non-functional requirements.

    Responsibilities
    Maintains close awareness of new and emerging technologies and their potential application for service offerings and products.
    . Work with architect and lead engineers for solutions to meet functional and non-functional requirements.
    . Demonstrated knowledge of relevant industry trends and standards.
    . Demonstrate strong analytical and technical problem-solving skills.
    . Must have experience in Data Engineering domain.
    Qualifications we seek in you
    Minimum Qualifications
    Bachelor's Degree or equivalency (CS, CE, CIS, IS, MIS, or engineering discipline) or equivalent work experience.
    . Maintains close awareness of new and emerging technologies and their potential application for service offerings and products.
    . Work with architect and lead engineers for solutions to meet functional and non-functional requirements.
    . Demonstrated knowledge of relevant industry trends and standards.
    . Demonstrate strong analytical and technical problem-solving skills.
    . Must have excellent coding skills either Python or Scala, preferably Python.
    . Must have experience in Data Engineering domain .Must have implemented at least 4 project end-to-end in Databricks.
    . Must have at least experience on databricks which consists of various components as below


    Must have skills:
    Azure data factory, Azure data bricks, Python and Pyspark
    . Expert with database technologies and ETL tools.
    . Hands-on experience on designing and developing scripts for custom ETL processes and automation in Azure data factory, Azure databricks, Python, Pyspark etc.
    . Good knowledge of AZURE, AWS, GCP Cloud platform services stack
    . Hands-on experience on designing and developing scripts for custom ETL processes and automation in Azure data factory, Azure databricks,Delta lake, Databricks workflows orchestration, Python, Pyspark etc.
    . Good Knowledge on Unity Catalog implementation.
    . Good Knowledge on integration with other tools like - DBT, other transformation tools.
    . Good knowledge on Unity Catalog integration with Snowlflake
    . Must be well versed with Databricks Lakehouse concept and its implementation
    in enterprise environments.
    . Must have good understanding to create complex data pipeline
    . Must have good knowledge of Data structure & algorithms.
    . Must be strong in SQL and sprak-sql.
    . Must have strong performance optimization skills to improve efficiency and reduce cost.
    . Must have worked on both Batch and streaming data pipeline.
    . Must have extensive knowledge of Spark and Hive data processing framework.
    . Must have worked on any cloud (Azure, AWS, GCP) and most common services like ADLS/S3, ADF/Lambda, CosmosDB/DynamoDB, ASB/SQS, Cloud databases.
    . Must be strong in writing unit test case and integration test
    . Must have strong communication skills and have worked on the team of size 5 plus
    . Must have great attitude towards learning new skills and upskilling the existing skills.
    Preferred Qualifications/ Skills
    Good to have Unity catalog and basic governance knowledge.
    . Good to have Databricks SQL Endpoint understanding.
    . Good To have CI/CD experience to build the pipeline for Databricks jobs.
    . Good to have if worked on migration project to build Unified data platform.
    . Good to have knowledge of DBT.
    . Good to have knowledge of docker and Kubernetes.
    Why join Genpact
    .Lead AI-first transformation - Build and scale AI solutions that redefine industries
    .Make an impact - Drive change for global enterprises and solve business challenges that matter
    .Accelerate your career-Gain hands-on experience, world-class training, mentorship, and AI certifications to advance your skills
    .Grow with the best - Learn from top engineers, data scientists, and AI experts in a dynamic, fast-moving workplace
    .Committed to ethical AI - Work in an environment where governance, transparency, and security are at the core of everything we build
    .Thrive in a values-driven culture - Our courage, curiosity, and incisiveness - built on a foundation of integrity and inclusion - allow your ideas to fuel progress

    Come join the 140,000+ coders, tech shapers, and growth makers at Genpact and take your career in the only direction that matters: Up.

    Let's build tomorrow together.

    Genpact is an Equal Opportunity Employer and considers applicants for all positions without regard to race, color, religion or belief, sex, age, national origin, citizenship status, marital status, military/veteran status, genetic information, sexual orientation, gender identity, physical or mental disability or any other characteristic protected by applicable laws.

    Genpact is committed to creating a dynamic work environment that values respect and integrity, customer focus, and innovation.

    Furthermore, please do note that Genpact does not charge fees to process job applications and applicants are not required to pay to participate in our hiring process in any other way.

    Examples of such scams include purchasing a %27starter kit,%27 paying to apply, or purchasing equipment or training.
  • Work in company

    Python, Pyspark and AWS

    confidential

    Understanding of core Business Intelligence BI data warehousing technology ETL, RDBMS etc. · Work with the application development teams throughout the development life cycle. · Create Airflow DAG pipelines for data ingestion. · Hands on knowledge of Scripting languages like Pyth ...

    Hyderabad / Secunderabad, Telangana Full time

    5 days ago

  • Work in company

    python,pyspark,aws

    confidential

    Total Yrs. of Experience5+ Relevant Yrs. · of experience5 Detailed JD *(Roles and Responsibilities) Strong candidate having Development experience on AWS Glue, Pyspark, S3 bucket, Lambdas, Dynamo, Python and well-versed in AWS Cloud Ecosystem. · Troubleshoot expertise in AWS eco ...

    Hyderabad / Secunderabad, Telangana Full time

    5 days ago

  • Work in company

    AWS, Databricks, Python, Pyspark

    confidential

    Job Description: · Lead Data Engineer AWS Databricks Python Pyspark · Key Responsibilities: · A day in the life of an Infoscion · As part of the Infosys consulting team your primary role would be to lead the engagement effort of providing high quality and value adding consulting ...

    Hyderabad / Secunderabad, Telangana, India Full time

    5 days ago

  • Work in company

    Data Engineer

    Virtusa

    Seeking a skilled Data Engineer to work on cloud-based data pipelines and analytics platforms. The ideal candidate will have hands-on experience in PySpark and AWS, with proficiency in designing Data Lakes and working with modern data orchestration tools. · Data Engineer to work ...

    Hyderabad / Secunderabad, Telangana ₹900,000 - ₹2,500,000 (INR) per year Full time

    1 day ago

  • Work in company

    Cloud Architect

    confidential

    Looking for 10+ Y / highly experienced and deeply hands-on Data Architect to lead the design, build, and optimization of our data platforms on AWS and Databricks. This role requires a strong blend of architectural vision and direct implementation expertise, ensuring scalable, sec ...

    Hyderabad / Secunderabad, Telangana ₹2,500,000 - ₹5,500,000 (INR) per year Full time

    5 days ago

  • Work in company

    Data Engineering Architect

    Virtusa

    Proficiency in PySpark for distributed data processing and transformation. · Solid experience with AWS Glue for ETL jobs and managing data workflows. · Hands-on experience with AWS Data Pipeline (DPL) for workflow orchestration. · Strong experience with AWS services such as S3, L ...

    Hyderabad / Secunderabad, Telangana ₹1,800,000 - ₹4,200,000 (INR) per year Full time

    1 day ago

  • Work in company

    Cloud Architect

    confidential

    Looking for 10+ Y / highly experienced and deeply hands-on Data Architect to lead the design, build, and optimization of our data platforms on AWS and Databricks. This role requires a strong blend of architectural vision and direct implementation expertise, ensuring scalable, sec ...

    Hyderabad / Secunderabad, Telangana ₹2,500,000 - ₹5,500,000 (INR) per year Full time

    5 days ago

  • Work in company

    Data Engineer

    Virtusa

    Experience: · 8+ years of experience in data engineering, specifically in cloud environments like AWS. · Proficiency in PySpark for distributed data processing and transformation. · Solid experience with AWS Glue for ETL jobs and managing data workflows. · Hands-on experience wit ...

    Hyderabad / Secunderabad, Telangana ₹900,000 - ₹2,500,000 (INR) per year Full time

    1 day ago

  • Work in company

    Aws Data Engineer

    confidential

    As part of the offshore development team, the AWS Developers will be responsible for implementing ingestion and transformation pipelines using PySpark, orchestrating jobs via MWAA, and converting legacy Cloudera jobs to AWS-native services. · Key Responsibilities: · Write ingesti ...

    Hyderabad / Secunderabad, Telangana ₹900,000 - ₹2,800,000 (INR) per year Full time

    5 days ago

  • Work in company

    Senior Data Engineer

    CareerNet Technologies Private Limited

    Role Responsibilities: · Lead ETL architecture and data pipeline design · Develop scalable solutions using AWS Glue and PySpark · Optimize data transformations for large-scale processing · Collaborate with teams to deliver architecture aligned to business needs · Key Deliverables ...

    Hyderabad / Secunderabad, Telangana ₹2,200,000 - ₹4,500,000 (INR) per year Full time

    1 day ago

  • Work in company

    AWS Python

    Virtusa

    Job Title: AWS Python Developer · Key Responsibilities · As an AWS Python Developer, you will: · Data Engineering: Utilize Python and PySpark to perform various data engineering tasks, contributing to the development and maintenance of data pipelines. · Big Data Solutions: Apply ...

    Hyderabad / Secunderabad, Telangana ₹600,000 - ₹1,800,000 (INR) per year Full time

    1 day ago

  • Work in company

    AWS Data Engineer

    confidential

    Job Responsibilities: · Design, develop, and maintain robust data pipelines and ETL processes using AWS services, with a focus on AWS Glue and Redshift. · Implement data processing solutions using Python and PySpark. · Understand complex data requirements by working closely with ...

    Hyderabad / Secunderabad, Telangana ₹900,000 - ₹2,800,000 (INR) per year Full time

    5 days ago

  • Work in company

    Pyspark/ Python developer

    confidential

    We are seeking a Pyspark/Python Developer with strong design and development skills for building data pipelines. The ideal candidate will have experience working on AWS/AWS CLI, with AWS Glue being highly desirable. You should possess hands-on SQL experience and be well-versed wi ...

    Hyderabad / Secunderabad, Telangana Full time

    5 days ago

  • Work in company

    PySpark Developer

    confidential

    Key Skills & Responsibilities · Strong expertise in PySpark and Apache Spark for batch and real-time data processing. · Experience in designing and implementing ETL pipelines, including data ingestion, transformation, and validation. · Proficiency in Python for scripting, automat ...

    Hyderabad / Secunderabad, Telangana ₹800,000 - ₹2,200,000 (INR) per year Full time

    5 days ago

  • Work in company

    Databricks Pyspark

    confidential

    Develop and optimize data processing jobs using PySpark to handle complex transformations and aggregations efficiently · Design and implement robust data pipelines on the AWS platform (Databricks exposure is a plus) · Utilize AWS services like EC2, S3 for scalable data processing ...

    Hyderabad / Secunderabad, Telangana ₹900,000 - ₹2,600,000 (INR) per year Full time

    5 days ago

  • Work in company

    aws

    confidential

    Total years of experience: 8 to 10 years · Relevant years of experience: 4 to 6 years · Should be strong in AWS · Good understanding and hands-on experience with AWS pipelines · Good communication skills · Solid experience in AWS development · Mandatory Skills: AWS · Desired Skil ...

    Hyderabad / Secunderabad, Telangana ₹150,000 - ₹350,000 (INR) per year Full time

    5 days ago

  • Work in company

    Python Developer

    CGI Information Systems and Management Consultants Private Limited

    We are looking for a highly skilled Data Engineer with strong expertise in Python, PySpark, and AWS cloud services. The ideal candidate will design, develop, and maintain scalable data pipelines while ensuring seamless data integration and transformation across systems. · Your fu ...

    Hyderabad / Secunderabad, Telangana ₹600,000 - ₹2,000,000 (INR) per year Full time

    1 day ago

  • Work in company

    python,pyspark

    confidential

    Develop and optimize data processing jobs using PySpark for complex transformations and aggregations · Design and implement robust data pipelines on AWS, ensuring scalability and performance · Utilize AWS services like EC2 and S3 for data processing and storage solutions · Manage ...

    Hyderabad / Secunderabad, Telangana ₹600,000 - ₹2,200,000 (INR) per year Full time

    5 days ago

  • Work in company

    PySpark

    confidential

    Key Responsibilities: · PySpark Development: · Design, implement, and optimize PySpark solutions for large-scale data processing and analysis. · Develop data pipelines using Spark to handle data transformations, aggregations, and other complex operations efficiently. · Write and ...

    Hyderabad / Secunderabad, Telangana ₹600,000 - ₹2,200,000 (INR) per year Full time

    5 days ago

  • Work in company

    Data Engineer

    Virtusa

    Job Title: Senior Data Engineer · Location · Hyderabad, Telangana, India · Key Responsibilities · As a Senior Data Engineer, you will: · Data Pipeline Development: Design, build, and maintain scalable data pipelines using PySpark and Python. · AWS Cloud Integration: Work with AWS ...

    Hyderabad / Secunderabad, Telangana ₹900,000 - ₹2,500,000 (INR) per year Full time

    1 day ago

Jobs