- Assist in the design, development, and maintenance of data pipelines and ETL processes for GenAI projects.
- Work closely with data scientists and software engineers to support the implementation of machine learning models and algorithms.
- Help optimize data infrastructure and storage solutions to ensure efficient data processing.
- Gain experience with event-driven architectures to enable real-time data processing and analysis.
- Learn and assist with containerization technologies like Kubernetes and Docker for deployment and scalability.
- Support the development and maintenance of data lakes for managing large volumes of structured and unstructured data.
- Contribute to the integration of LLM frameworks (such as Langchain and Semantic Kernel) for advanced language processing and analysis.
- Collaborate with cross-functional teams to support the design and implementation of solution architectures for GenAI projects.
- Utilize cloud computing platforms such as Azure or AWS under supervision for data processing, storage, and deployment.
- Participate in monitoring and troubleshooting of data pipelines and systems to ensure smooth operations.
- Stay informed about the latest advancements in GenAI technologies and assist in recommending innovative solutions to enhance data engineering processes.
- Engage with cross-functional teams to help understand business requirements and contribute to translating them into technical solutions.
- Assist in documenting data engineering processes, methodologies, and best practices.
- Bachelor's degree in Computer Science, Data Science, or a related field.
- 1-3 years of relevant experience, ideally with some exposure to GenAI projects.
- Basic programming skills in Python.
- Familiarity with data processing frameworks like Apache Spark or similar.
- Understanding of SQL and basic database management systems.
- Some knowledge of event-driven architectures and real-time data processing.
- Exposure to containerization technologies like Kubernetes and Docker.
- Awareness of data lakes and basic data lake management principles.
- Some familiarity with LLM frameworks such as Langchain and Semantic Kernel.
- Experience with cloud computing platforms such as Azure or AWS is a plus.
- Strong analytical and problem-solving skills.
- Good communication and collaboration abilities.
- Ability to work in a fast-paced and dynamic environment.
- Exposure to additional technologies such as Databricks, Azure AI Search, Azure OpenAI, Azure Event Hub, Azure Data Lake Storage, AWS Open Search, AWS Bedrock, AWS Event Bridge, AWS S3, Azure Key Vault,DataDog, and Splunk.
-
Data Enginer
6 days ago
NatWest Group Bengaluru, Karnataka, IndiaOur people work differently depending on their jobs and needs. From hybrid working to flexible hours, we have plenty of options that help our people to thrive. · This role is based in India and as such all normal working days must be carried out in India. · Join us as a Data Engi ...
-
Data Engine
1 week ago
Decathlon Bengaluru, IndiaPermanent contract · - Full-time · - Mid-Senior level · - BTEC Higher National Diploma, Diploma of Higher Education · - Data engineer · **Mission**: · **Our Purpose**: · **_"Move people through the wonders of Sport"_** · **About Decathlon Sports India**: · Founded in 1976 in Fran ...
-
Data Engine
1 week ago
Decathlon India Bengaluru, India**Our Purpose**: *"Move people through the wonders of Sport"*About Decathlon Sports India: · Founded in 1976 in France, we have set about making the pleasure and benefit of sports available for everyone across the globe. We do that by providing world-class products both for enthu ...
-
Data Engineer t9
3 days ago
Mercedes-Benz Research and Development India Private Limited Bengaluru, India**Aufgaben**: · - Education: Masters/Bachelors in Computer Science, Electrical / Electronics or Equivalent engineering · Good analytics skills · - Skill Requirements: · - Excellent Programming skills in Python. · - Experience with cloud technologies like Azure, AWS, GCP, public o ...
-
Data Engineer-2
12 hours ago
Deutsche Bank Bengaluru, Karnataka, India**Data Engineer-2**: · **Job ID**:R0333521**Full/Part-Time**:Full-time**Regular/Temporary**:Regular**Listed**: **Location**:Bangalore**Position Overview**: · **Job Title - Data Engineer** · **Location - Bangalore, India** · **Role Description** · Role is an Data Engineer to manag ...
-
Data Engineer-1
1 week ago
Commonwealth Bank Bengaluru, India**Your business**: · The Commonwealth Bank is the leading financial institution in Australia and provides integrated financial services. · The role sits within the Bankwest Technology division. Bankwest is a subsidiary of The Commonwealth Bank, and the Bankwest Technology divisio ...
-
Data Engineer 169368 Full-time
1 week ago
HyreFox Consultants Bengaluru, India Full timeBuild and maintain end-to-end data engineering pipelines on batch data. · - Design and implement batch data ingestion pipelines. · - Design and implement batch data transformation pipelines. · - Design and implement batch data storage solutions. · - Implement batch data governanc ...
-
Azure Data Engineer-3-10years-hyderabad
1 week ago
Black & White Business Solutions Bengaluru, India**Job Information**: · Industry · **IT Services** · *** · Province · **Karnataka** · *** · City · **Bangalore North** · *** · Postal Code · **560001** · *** · Country · **India** · Job Title:Azure data Bricks · Years of EXP:3 to 10Years · Location:Hyderabad · NP:30Days/Immediate ...
-
Data Engineer
20 hours ago
Genpact Bengaluru, IndiaInviting applications for the role of · Principal Consultant-Senior Data Engineer · Include optimizing data pipelines, ensuring data integrity and consistency, enhancing system resiliency where applicable, maintaining and improving data security, proactive alerting, and monitorin ...
-
Engineer, Data
1 week ago
Giant Eagle GCC , Karnataka, IndiaJob Summary · As a Data Engineer on the Customer Loyalty & Experience team, you will be working on a team to bring customer-centric personalization to life. In this role, you will be empowered to develop data solutions in support of marketing analytics and data science by engagin ...
-
Data Engineer
20 hours ago
Recro Bengaluru, IndiaExperience:3+ years · Work location: Bangalore · primary_skills(Must_have) · - Programming Skills: Proficiency in Python, Pyspark, and SQL is essential. · - Big Data Experience: Hands-on experience with Spark and relational databases such as Postgres is required. · - Orchestratio ...
-
Data Engineers
1 week ago
Multplyr Bengaluru, IndiaPayroll Company: Multplyr · Role: Data Engineers · Experience: years, across levels · Location: Hybrid / WFO at our client offices in Bengaluru, Mumbai, Pune, Delhi/NCR, Hyderabad and Chennai · Type: Contract / Contract To Hire · Typical Duration: months · About Us · Multplyr is ...
-
Data Engineer
5 days ago
SP Software Solutions Bengaluru, IndiaAzure Date Engineer · Multiple Locations in India · (Bengaluru, Chennai, Hyderabad, Kochi, Kolkata, Lucknow, Mumbai, Noida, Pune) · Strong experience in SQL, Azure, Azure Data Factory, Databricks, Python, Spark, PySpark · Moderate experience in CI/CD · Requirements: · Strong pr ...
-
Data Engineer
1 day ago
Mobile Programming LLC Bangalore, IndiaJob Description : · Please note : This position is focused on development rather than migration. We are seeking an experienced Data Engineer to join our team. · As a Data Engineer, you will play a crucial role in developing and maintaining our data infrastructure and ensuring t ...
-
Data Engineer
20 hours ago
Joveo Bengaluru, IndiaWe are looking for talented Data Engineers who are passionate about data engineering and have strong experience in building scalable data pipelines. As a Data Engineer at Joveo, you will play a leading role in designing and building datasets that power analytics for teams across ...
-
Data Engineer
20 hours ago
Ascendion Bengaluru, India· Job Title: Data Engineer/ Lead · Duration: Full Time · Location: Bengaluru, Hyderabad, Chennai, Pune (Hyrbrid) · NOTE: Looking for Immediate Joiners ( 2-3 weeks notice) · Proficient in Azure Cloud services (or GCP is Ok) for data engineering tasks. · Familiarity with Kubeflow, ...
-
Data Engineer
1 week ago
Teamware Solutions a division of Quantum Leap Consulting Pvt. Ltd Bengaluru, IndiaGreetings from @Teamware Solutions. . · Hope you doing well Join our family Here we are hiring Data Engineer · Job Position: Data Engineer · Job Type: Full-Time · Job Location: Pan India · Job Description: · The right candidate has (Responsibilities); · Provide Wealth Management ...
-
Data Engineer
20 hours ago
JRD Systems Bengaluru, IndiaRole · : Data Engineer - AWS and Oracle Expert · Job Summary: · We are seeking a highly skilled and experienced Data Engineer with expertise in data development in AWS and Oracle. The ideal candidate will have a minimum of 5 years of experience in data engineering, with a strong ...
-
Sr Data Engineer/Data Engineer
1 week ago
Trigent Software - Professional Services Bengaluru, IndiaSenior Data Engineer (5+ Years) / Data Engineer (3+): · Experience working with distributed technology tools for developing Batch and Streaming pipelines using · SQL, Spark, PySpark, · Airflow [3+ years], · Spark with Scala (optional). · Able to write code which is optimized ...
-
Data Engineer
1 day ago
Coders Brain Pvt Ltd bangalore, IndiaJob Overview : · JD - Python and Snowflake · - Experienced Data engineer(6+) responsible for developing, overseeing, organizing, storing, and analyzing data and data systems. · - Responsible for Cloud migrations for data pipelines using AWS and Snowflake · - Participate in all as ...
Data Engineer - bangalore, India - PricewaterhouseCoopers Service Delivery Center (Bangalore) Private Limited
Description
Description
: GenAI Data Engineer - AssociatePwC US - Acceleration Center is seeking an enthusiastic and emerging GenAI Data Engineer to join our team at the Associate level. This role is ideal for individuals passionate about data engineering and eager to develop their skills in GenAI technologies. As an Associate GenAI Data Engineer, you will contribute to developing and maintaining data pipelines, implementing machine learning models, and optimizing data infrastructure for our GenAI projects under the guidance of more experienced team members.
Responsibilities:
Requirements:
Nice to Have Skills:
If you are early in your data engineering career and enthusiastic about GenAI technologies, join PwC US - Acceleration Center as an Associate GenAI Data Engineer. Here, you will develop your skills and contribute to innovative projects in a supportive and collaborative work environment.
Education
Degrees/Field of Study required:Degrees/Field of Study preferred:Certifications
Required Skills
Optional Skills
Desired Languages
Travel Requirements
Not SpecifiedAvailable for Work Visa Sponsorship?
NoGovernment Clearance Required?
NoJob Posting End Date