Jobs
>
Hyderabad

    Data Engineer- Gen AI - Hyderabad, India - PricewaterhouseCoopers Service Delivery Center (Bangalore) Private Limited

    PricewaterhouseCoopers Service Delivery Center (Bangalore) Private Limited background
    Description
    :
    GenAI Data Engineering - Manager


    PwC US - Acceleration Center is looking for an experienced and visionary GenAI Data Engineer to join our team as a Manager.

    This leadership role involves overseeing the development and maintenance of data pipelines, the implementation of machine learning models, and the optimization of data infrastructure for our GenAI projects.

    The ideal candidate will have an extensive background in data engineering, with a deep focus on GenAI technologies, and a solid understanding of data processing, event-driven architectures, containerization, and cloud computing.


    Responsibilities:
    Lead the design, development, and maintenance of robust data pipelines and ETL processes for GenAI projects.

    Manage and guide a team of data scientists and software engineers in implementing complex machine learning models and algorithms.

    Strategize and optimize data infrastructure and storage solutions to ensure efficient, scalable, and reliable data processing across projects.

    Champion the implementation of event-driven architectures to facilitate real-time data processing and analysis.

    Oversee the deployment of containerization technologies like Kubernetes and Docker to enhance scalability and operational efficiency.

    Direct the development and governance of data lakes, ensuring effective management of large volumes of structured and unstructured data.

    Lead the integration of LLM frameworks (such as Langchain and Semantic Kernel) to advance language processing and analytical capabilities.

    Collaborate with cross-functional teams to architect and implement solution frameworks that align with GenAI project goals.

    Leverage cloud computing platforms like Azure or AWS to maximize data processing, storage, and deployment efficiency.

    Monitor, diagnose, and resolve issues within data pipelines and systems to maintain continuous and smooth operations.

    Stay at the forefront of GenAI technology advancements and introduce innovative solutions to elevate data engineering practices.

    Translate complex business requirements into effective technical solutions, driving project success and technological innovation.

    Document and standardize data engineering processes, methodologies, and best practices across teams.

    Ensure professional development and certification in solution architecture for team members, maintaining industry best practices.

    Requirements:
    Bachelor's or Master's degree in Computer Science, Data Science, or a related field.

    10+ years of relevant technical/technology experience, with a strong emphasis on GenAI projects.

    Advanced programming skills in Python and proficiency in data processing frameworks like Apache Spark.

    Expertise in SQL and sophisticated database management systems.

    In-depth knowledge of event-driven architectures and real-time data processing.

    Proven experience with containerization technologies like Kubernetes and Docker.

    Extensive experience managing data lakes and understanding of data lake architecture.

    Familiarity with LLM frameworks such as Langchain and Semantic Kernel.

    Robust experience with cloud computing platforms such as Azure or AWS.

    Exceptional leadership, problem-solving, and analytical skills.

    Superior communication and collaboration abilities, capable of leading high-performing teams.

    Ability to navigate a fast-paced and dynamic work environment.

    Nice to Have Skills:


    Proficiency with technologies like Databricks, Azure AI Search, Azure OpenAI, Azure Event Hub, Azure Data Lake Storage, AWS Open Search, AWS Bedrock, AWS Event Bridge, AWS S3, Azure Key Vault, Hashicorp Key Vault, DataDog, and Splunk.

    Relevant advanced certifications in solution architecture and cloud computing.


    Join PwC US - Acceleration Center as a Manager in GenAI Data Engineering to lead strategic initiatives and contribute to pioneering GenAI solutions.

    We offer a stimulating work environment that fosters innovation and significant opportunities for professional growth and advancement.


    EducationDegrees/Field of Study required:

    Degrees/Field of Study preferred:
    CertificationsRequired SkillsOptional SkillsDesired LanguagesTravel RequirementsNot Specified

    Available for Work Visa Sponsorship?No

    Government Clearance Required?No

    Job Posting End Date

  • Kore, Inc

    - Se

    1 week ago


    Kore, Inc Hyderabad, India

    JOB DESCRIPTION: Node Js Developer · At Kore, we're committed to creating the world's best virtual assistants that run on the power of cutting-edge AI and ML. We've worked closely with product teams, marketing teams and sales teams to share our vision with you. If you've ever dre ...


  • NetBrain Hyderabad, India

    Founded in 2004, NetBrain is the leader in no-code network automation. Its ground-breaking Next-Gen platform provides IT operations teams with the ability to scale their hybrid multi-cloud connected networks by automating the processes associated with Diagnostic Troubleshooting, ...


  • Novartis Hyderabad, Telangana, India

    392536BR · **Snr. Spec. Platform Analytics AI (Machine Learning on AWS & MLOps**: · India · **About the role** · Location: Hyderabad · Develop, Test, Deploy and Maintain Machine Learning models at scale. Focus on building end-to-end pipelines for model training, testing and deplo ...


  • Novartis Hyderabad, Telangana, India

    Location: Hyderabad · About the role: Develop, Test, Deploy and Maintain Machine Learning models at scale. Focus on building end-to-end pipelines for model training, testing and deployment. Have ability to design and implement MLOps framework from an as is state, to the future. P ...


  • Novartis Hyderabad, Telangana, India

    389594BR · **Assoc. Dir. DDIT Dev. Serv Ops TRD, RA**: · India · **About the role** · Role Title: Assoc. Director DDIT Dev. Service Ops TRD, RA · Location: Hyderabad · Role Purpose: · This role requires the incumbent to manage end-to-end Service Delivery & Operations for IT Appli ...


  • UST Hyderabad, India

    Technical Program Manager (TPM) is responsible to track the activities Software Sustaining PMs Key Responsibilities: PM for Gen9 Sustaining after the transition from NPI to Sustaining (FW Change management) – All SW Sustaining PMs are located in TWN and they will manage this vend ...

  • Cyient

    Sales Director

    1 week ago


    Cyient Hyderabad, India

    Drive new client business in India for our 5 key service offerings: · Semiconductor Services & Turnkey ASIC Solutions · Automotive Software Solutions · Digital Solutions - IoT & Analytics · Design Led Manufacturing 'DLM' · Product Engineering - Mechanical, Electronic and Embedded ...


  • HCLTech Hyderabad, India

    Generative AI Lead Developer (Preferred Azure) · Job location: Hyderabad, Noida, Bangalore, Chennai · Total Experience: 7+ Years · Relevant Experience: 2+ Years · Responsibilities: · Architect end-to-end generative AI solutions on Microsoft Azure platform, including data ingestio ...


  • HCLTech Hyderabad, India

    Generative AI Architect (Preferred Azure) · Job location: Hyderabad, Noida, Bangalore, Chennai · Experience: Overall 15+ years & 3+ years of experience in AI Architecture. · Responsibilities: · Architect end-to-end generative AI solutions on Microsoft Azure platform, including da ...


  • HCLTech Hyderabad, India

    Generative AI Technical Lead (Preferred Azure) · Job location: Hyderabad, Noida, Bangalore, Chennai · Total Experience: 10+ Years · Relevant Experience: 3+ Years · Responsibilities: · Architect end-to-end generative AI solutions on Microsoft Azure platform, including data ingesti ...


  • CBRE Hyderabad, India

    As an Enterprise Architect, D&T, you will be a catalyst in strategic digital transformation initiatives. You will be responsible for helping to define the future architecture and capabilities in technology domains such as Data, AI, Cloud, Automation, Integrations & Digital Produc ...


  • Evernorth Health Services Hyderabad, India

    ABOUT EVERNORTH: · Evernorth exists to elevate health for all, because we believe health is the starting point for human potential and progress. As champions for affordable, predictable and simple health care, · we solve the problems others don't, won't or can't. Our innovation ...


  • Evernorth Health Services Hyderabad, India

    ABOUT EVERNORTH: · Evernorth exists to elevate health for all, because we believe health is the starting point for human potential and progress. As champions for affordable, predictable and simple health care, · we solve the problems others don't, won't or can't. · Our innovat ...


  • Synopsys Inc Hyderabad, India

    This position offers a wonderful opportunity to work on the most challenging technical problems in the verification domain and innovative technologies under Synopsys Verification Platform. Looking for an experienced and motivated professional who enjoys problem solving. Is open t ...


  • Paladin Hyderabad, India

    Company Description: · Paladin is at the forefront of emergency response technology. Our flagship drone, Knighthawk, delivers real-time overhead views to first responders within 90 seconds of a 911 call, transforming situational awareness and drastically reducing response times. ...


  • Evernorth Health Services Hyderabad, India

    ABOUT EVERNORTH: · Evernorth exists to elevate health for all, because we believe health is the starting point for human potential and progress. As champions for affordable, predictable and simple health care, · we solve the problems others don't, won't or can't. · Our innovat ...


  • BreachLock Inc Hyderabad, India Full time

    About Breachlock: · BreachLock is an Innovative Cybersecurity Company deploying new-age technology to make Cyberspace a safe place for everyone. · Recognized by Gartner as a key Cybersecurity Innovator 3 years in a row, BreachLock is a growth Scaleup with Offices in the US, Europ ...


  • BreachLock Inc Hyderabad, India

    About Breachlock: · BreachLock is an Innovative Cybersecurity Company deploying new-age technology to make Cyberspace a safe place for everyone. · Recognized by Gartner as a key Cybersecurity Innovator 3 years in a row, BreachLock is a growth Scaleup with Offices in the US, Europ ...


  • BreachLock Inc Hyderabad, India

    About Breachlock · BreachLock is a Global Leader in Penetration Testing as a Service (PTaaS) that makes staying resilient against cyber-attacks painless for 700+ active clients in over 20 countries. · Empowering organizations to overcome the four fundamental challenges faced with ...


  • Microsoft Telangana, India

    Overview · AI is the strategic bet for Microsoft. The Azure AI Platform is right at the front end. Our project involves cutting edge technologies and problems. Joining the projects you will gain knowledge and experience about generative AI, large language model, transformers, GPU ...