- Experienced in building data pipelines to Ingest, process, and transform data from files, streams and databases. Process the data with Spark, Python, PySpark, Scala, and Hive, Hbase or other NoSQL databases on Cloud Data Platforms (AWS) or HDFS
- Experienced in develop efficient software code for multiple use cases leveraging Spark Framework / using Python or Scala and Big Data technologies for various use cases built on the platform
- Experience in developing streaming pipelines
- Experience to work with Hadoop / AWS eco system components to implement scalable solutions to meet the ever-increasing data volumes, using big data/cloud technologies Apache Spark, Kafka, any Cloud computing etc
- Total years of experience in Data Management (DW, DL, Data Platform, Lakehouse) and Data Engineering skills
- Minimum 4+ years of experience in Big Data technologies with extensive data engineering experience in Spark / Python or Scala.
- Minimum 3 years of experience on Cloud Data Platforms on AWS; Exposure to streaming solutions and message brokers like Kafka technologies.
- Experience in AWS EMR / AWS Glue / DataBricks, AWS RedShift, DynamoDB
- Good to excellent SQL skills
- Certification in AWS and Data Bricks or Cloudera Spark Certified developers
- AWS S3, Redshift, and EMR for data storage and distributed processing.
- AWS Lambda, AWS Step Functions, and AWS Glue to build serverless, event-driven data workflows and orchestrate ETL processes
-
Your role and responsibilities · As a senior SAP Consultant, you will serve as a client-facing practitioner working collaboratively with clients to deliver high-quality solutions and be a trusted business advisor with deep understanding of SAP Accelerate delivery methodology or e ...
Bengaluru / Bangalore Full time3 days ago
-
Your role and responsibilities · As Data Engineer, you will develop, maintain, evaluate and test big data solutions. You will be involved in the development of data solutions using Spark Framework with Python or Scala on Hadoop and AWS Cloud Data Platform · Required education · B ...
Bengaluru / Bangalore Full time3 days ago
-
In this role, you'll work in one of our IBM Consulting Client Innovation Centers (Delivery Centers). These centers are where we deliver deep technical and industry expertise to a wide range of public and private sector clients around the world. Our delivery centers offer our clie ...
Bengaluru / Bangalore Full time3 days ago
-
Introduction · In this role, you'll work in one of our IBM Consulting Client Innovation Centers (Delivery Centers), where we deliver deep technical and industry expertise to a wide range of public and private sector clients around the world. Our delivery centers offer our clients ...
Bengaluru / Bangalore, India Full time3 days ago
-
This role involves working in an IBM Consulting Client Innovation Center to deliver technical expertise to clients worldwide. As a Data Engineer, you will work with diverse teams to decide on suitable data management systems and identify crucial data for insightful analysis. · ...
Bengaluru4 weeks ago
-
Job Summary: · The Data Platform team in Avis is a level 3 technology specialist team to roll out new capabilities in to cloud to support data engineers, analysts, and business teams. This role does not require night shifts but need to have overlapping hours between IST and US ea ...
Bengaluru1 week ago
-
Design and develop data pipelines for Generative AI projects by leveraging a combination of technologies, including Vector DB, Graph DB, Airflow, Spark, PySpark, Python, LangChain, AWS Functions, Redshift, and SSIS. This will involve the logical and efficient integration of these ...
Bengaluru / Bangalore Full time3 days ago
-
+ PwC is looking for an experienced AWS Platform Engineer with strong expertise in Infrastructure & Infrastructure as Code (IaC) to design, implement and manage scalable cloud platforms.+Design and implement AWS cloud solutions aligned with project requirements and best practices ...
Bengaluru1 month ago
-
We are seeking a talented and experienced AWS Platform Engineer with a strong background in Python to join our core engineering team. · ...
Bengaluru, Karnataka1 month ago
-
PwC is looking for an experienced AWS Platform Engineer with strong expertise in Infrastructure & Infrastructure as Code (IaC) to design, implement and manage scalable cloud platforms. · ...
Greater Bengaluru Area1 month ago
-
Xperteez Technology is seeking an experienced AWS Platform Engineer with strong Full-Stack development expertise and hands-on experience with Backstage (Internal Developer Platform). The role focuses on building scalable, developer-centric platform capabilities and enhancing deve ...
Bengaluru1 month ago
-
We are looking for a highly skilled AWS Platform Engineer to design, build, and operate a secure, scalable, and developer-centric cloud platform. · ...
Bengaluru1 month ago
-
We are seeking a talented and experienced AWS Platform Engineer with a strong background in Python to join our core engineering team. · Design provision and manage core AWS infrastructure components including EC2 VPC S3 RDS DynamoDB Lambda API Gateway SQS SNS and Route53. · Devel ...
Bangalore4 weeks ago
-
Synechron is seeking a seasoned AWS Platform Engineer / DevOps & SRE to lead the design deployment and management of cloud-native platform components on AWS. · ...
Bengaluru1 month ago
-
The primary purpose of the Platforms Engineering Team is to provide engineering and operations support for platform technologies such as AWS. · ...
Bengaluru, Pune1 month ago
-
AWS Platform Engineer at Bangalore - Hybrid with ₹30 LPA. · Experience: 7-10 Years · ...
Bengaluru1 month ago
-
Job Summary:We are seeking a talented and experienced AWS Platform Engineer with a strong background in Python to join our core engineering team. · In this role, you will be instrumental in designing, building, · automating, and maintaining our cloud infrastructure on Amazon Web ...
Bengaluru1 month ago
-
+AWS Platform Mastery – Deep knowledge of EKS, Lambda, IAM, CloudFront. · +Infrastructure & Automation Leadership – Expert in Terraform, AWS CDK, · +Terraform,AWS CDK,Lambda, · ...
Bengaluru1 month ago
-
AWS Platform Engineer with 7-10 years of experience responsible for designing scalable IaC ecosystems with security baked in and enforcing guardrails via SCPs. The role requires expertise in EKS, Lambda, IAM, CloudFront, and Control Tower patterns. · ...
Bengaluru, Karnataka1 month ago
-
We are seeking a talented and experienced AWS Platform Engineer with a strong background in Python to join our core engineering team. · Design, provision, and manage core AWS infrastructure components including EC2, VPC, S3. · Develop and maintain Infrastructure as Code (IaC) usi ...
Bengaluru1 month ago
Data Engineer-Data Platforms-AWS - Bengaluru / Bangalore - IBM
Description
Your role and responsibilities
As Data Engineer, you will develop, maintain, evaluate and test big data solutions. You will be involved in the development of data solutions using Spark Framework with Python or Scala on Hadoop and AWS Cloud Data Platform
Required education
Bachelor's Degree
Preferred education
Master's Degree
Required technical and professional expertise
Preferred technical and professional experience
-
Data Engineer-Data Platforms-AWS
Full time IBM- Bengaluru / Bangalore
-
Data Engineer-Data Platforms-AWS
Full time IBM- Bengaluru / Bangalore
-
Data Engineer-Data Platforms-AWS
Full time IBM- Bengaluru / Bangalore
-
Data Engineer-Data Platforms-AWS
Full time IBM- Bengaluru / Bangalore, India
-
Data Engineer-Data Platforms-AWS
Only for registered members Bengaluru
-
Data Platform Engineer – OCI/AWS
Only for registered members Bengaluru
-
Data Engineer AWS/ Power platform Engineer
Full time Systechcorp Private Limited- Bengaluru / Bangalore
-
AWS Platform Engineer
Only for registered members Bengaluru
-
AWS Platform Engineer
Only for registered members Bengaluru, Karnataka
-
AWS Platform Engineer
Only for registered members Greater Bengaluru Area
-
AWS Platform Engineer
Only for registered members Bengaluru
-
AWS Platform Engineer
Only for registered members Bengaluru
-
AWS Platform Engineer
Only for registered members Bangalore
-
AWS Platform Engineer
Only for registered members Bengaluru
-
AWS Platform Engineer
Only for registered members Bengaluru, Pune
-
AWS Platform Engineer
Only for registered members Bengaluru
-
Aws Platform Engineer
Only for registered members Bengaluru
-
Aws Platform Engineer
Only for registered members Bengaluru
-
AWS Platform Engineer
Only for registered members Bengaluru, Karnataka
-
AWS Platform Engineer
Only for registered members Bengaluru