Data Engineer-Data Platforms-AWS - Bengaluru / Bangalore - IBM

    IBM
    IBM Bengaluru / Bangalore

    3 days ago

    Full time
    Description

    Your role and responsibilities

    As Data Engineer, you will develop, maintain, evaluate and test big data solutions. You will be involved in the development of data solutions using Spark Framework with Python or Scala on Hadoop and AWS Cloud Data Platform

    • Experienced in building data pipelines to Ingest, process, and transform data from files, streams and databases. Process the data with Spark, Python, PySpark, Scala, and Hive, Hbase or other NoSQL databases on Cloud Data Platforms (AWS) or HDFS 
    • Experienced in develop efficient software code for multiple use cases leveraging Spark Framework / using Python or Scala and Big Data technologies for various use cases built on the platform
    • Experience in developing streaming pipelines
    • Experience to work with Hadoop / AWS eco system components to implement scalable solutions to meet the ever-increasing data volumes, using big data/cloud technologies Apache Spark, Kafka, any Cloud computing etc

    Required education

    Bachelor's Degree

    Preferred education

    Master's Degree

    Required technical and professional expertise

    • Total years of experience in Data Management (DW, DL, Data Platform, Lakehouse) and Data Engineering skills
    • Minimum 4+ years of experience in Big Data technologies with extensive data engineering experience in Spark / Python or Scala.
    • Minimum 3 years of experience on Cloud Data Platforms on AWS; Exposure to streaming solutions and message brokers like Kafka technologies.
    • Experience in AWS EMR / AWS Glue / DataBricks, AWS RedShift, DynamoDB
    • Good to excellent SQL skills

    Preferred technical and professional experience

    • Certification in AWS and Data Bricks or Cloudera Spark Certified developers
    • AWS S3, Redshift, and EMR for data storage and distributed processing.
    • AWS Lambda, AWS Step Functions, and AWS Glue to build serverless, event-driven data workflows and orchestrate ETL processes

  • Your role and responsibilities · As a senior SAP Consultant, you will serve as a client-facing practitioner working collaboratively with clients to deliver high-quality solutions and be a trusted business advisor with deep understanding of SAP Accelerate delivery methodology or e ...

    Bengaluru / Bangalore Full time

    3 days ago

  • Your role and responsibilities · As Data Engineer, you will develop, maintain, evaluate and test big data solutions. You will be involved in the development of data solutions using Spark Framework with Python or Scala on Hadoop and AWS Cloud Data Platform · Required education · B ...

    Bengaluru / Bangalore Full time

    3 days ago

  • In this role, you'll work in one of our IBM Consulting Client Innovation Centers (Delivery Centers). These centers are where we deliver deep technical and industry expertise to a wide range of public and private sector clients around the world. Our delivery centers offer our clie ...

    Bengaluru / Bangalore Full time

    3 days ago

  • Introduction · In this role, you'll work in one of our IBM Consulting Client Innovation Centers (Delivery Centers), where we deliver deep technical and industry expertise to a wide range of public and private sector clients around the world. Our delivery centers offer our clients ...

    Bengaluru / Bangalore, India Full time

    3 days ago

  • Work in company

    Data Engineer-Data Platforms-AWS

    Only for registered members

    This role involves working in an IBM Consulting Client Innovation Center to deliver technical expertise to clients worldwide. As a Data Engineer, you will work with diverse teams to decide on suitable data management systems and identify crucial data for insightful analysis. · ...

    Bengaluru

    4 weeks ago

  • Work in company

    Data Platform Engineer – OCI/AWS

    Only for registered members

    Job Summary: · The Data Platform team in Avis is a level 3 technology specialist team to roll out new capabilities in to cloud to support data engineers, analysts, and business teams. This role does not require night shifts but need to have overlapping hours between IST and US ea ...

    Bengaluru

    1 week ago

  • Work in company

    Data Engineer AWS/ Power platform Engineer

    Systechcorp Private Limited

    Design and develop data pipelines for Generative AI projects by leveraging a combination of technologies, including Vector DB, Graph DB, Airflow, Spark, PySpark, Python, LangChain, AWS Functions, Redshift, and SSIS. This will involve the logical and efficient integration of these ...

    Bengaluru / Bangalore Full time

    3 days ago

  • Work in company

    AWS Platform Engineer

    Only for registered members

    + PwC is looking for an experienced AWS Platform Engineer with strong expertise in Infrastructure & Infrastructure as Code (IaC) to design, implement and manage scalable cloud platforms.+Design and implement AWS cloud solutions aligned with project requirements and best practices ...

    Bengaluru

    1 month ago

  • Work in company

    AWS Platform Engineer

    Only for registered members

    We are seeking a talented and experienced AWS Platform Engineer with a strong background in Python to join our core engineering team. · ...

    Bengaluru, Karnataka

    1 month ago

  • Work in company

    AWS Platform Engineer

    Only for registered members

    PwC is looking for an experienced AWS Platform Engineer with strong expertise in Infrastructure & Infrastructure as Code (IaC) to design, implement and manage scalable cloud platforms. · ...

    Greater Bengaluru Area

    1 month ago

  • Work in company

    AWS Platform Engineer

    Only for registered members

    Xperteez Technology is seeking an experienced AWS Platform Engineer with strong Full-Stack development expertise and hands-on experience with Backstage (Internal Developer Platform). The role focuses on building scalable, developer-centric platform capabilities and enhancing deve ...

    Bengaluru

    1 month ago

  • Work in company

    AWS Platform Engineer

    Only for registered members

    We are looking for a highly skilled AWS Platform Engineer to design, build, and operate a secure, scalable, and developer-centric cloud platform. · ...

    Bengaluru

    1 month ago

  • Work in company

    AWS Platform Engineer

    Only for registered members

    We are seeking a talented and experienced AWS Platform Engineer with a strong background in Python to join our core engineering team. · Design provision and manage core AWS infrastructure components including EC2 VPC S3 RDS DynamoDB Lambda API Gateway SQS SNS and Route53. · Devel ...

    Bangalore

    4 weeks ago

  • Work in company

    AWS Platform Engineer

    Only for registered members

    Synechron is seeking a seasoned AWS Platform Engineer / DevOps & SRE to lead the design deployment and management of cloud-native platform components on AWS. · ...

    Bengaluru

    1 month ago

  • Work in company

    AWS Platform Engineer

    Only for registered members

    The primary purpose of the Platforms Engineering Team is to provide engineering and operations support for platform technologies such as AWS. · ...

    Bengaluru, Pune

    1 month ago

  • Work in company

    AWS Platform Engineer

    Only for registered members

    AWS Platform Engineer at Bangalore - Hybrid with ₹30 LPA. · Experience: 7-10 Years · ...

    Bengaluru

    1 month ago

  • Work in company

    Aws Platform Engineer

    Only for registered members

    Job Summary:We are seeking a talented and experienced AWS Platform Engineer with a strong background in Python to join our core engineering team. · In this role, you will be instrumental in designing, building, · automating, and maintaining our cloud infrastructure on Amazon Web ...

    Bengaluru

    1 month ago

  • Work in company

    Aws Platform Engineer

    Only for registered members

    +AWS Platform Mastery – Deep knowledge of EKS, Lambda, IAM, CloudFront. · +Infrastructure & Automation Leadership – Expert in Terraform, AWS CDK, · +Terraform,AWS CDK,Lambda, · ...

    Bengaluru

    1 month ago

  • Work in company

    AWS Platform Engineer

    Only for registered members

    AWS Platform Engineer with 7-10 years of experience responsible for designing scalable IaC ecosystems with security baked in and enforcing guardrails via SCPs. The role requires expertise in EKS, Lambda, IAM, CloudFront, and Control Tower patterns. · ...

    Bengaluru, Karnataka

    1 month ago

  • Work in company

    AWS Platform Engineer

    Only for registered members

    We are seeking a talented and experienced AWS Platform Engineer with a strong background in Python to join our core engineering team. · Design, provision, and manage core AWS infrastructure components including EC2, VPC, S3. · Develop and maintain Infrastructure as Code (IaC) usi ...

    Bengaluru

    1 month ago

Jobs
>
Bengaluru