Data Engineer - Greater Hyderabad Area - BPMLinks

    BPMLinks
    BPMLinks Greater Hyderabad Area

    5 days ago

    Full time
    Description

    Job Title: Data Engineer - AWS MSK Specialist (Kafka Admin)

    Job Summary:

    We're looking for a skilled Data Engineer with expertise in AWS Managed Streaming for Apache Kafka (MSK) to design, build, and maintain high-performance data pipelines. You'll work closely with data architects and software engineers to ensure seamless data integration and streaming capabilities using AWS MSK.

    Responsibilities:

    - Design, develop, and manage real-time data pipelines using AWS MSK

    - Integrate AWS MSK with various data sources and consumers

    - Monitor and optimize AWS MSK cluster performance and costs

    - Collaborate with DevOps to ensure optimal performance and uptime

    - Implement security best practices for data streaming and storage

    - Document technical processes and best practices

    - Work with AWS services like S3, Glue, and Lambda for data processing and integration

    Requirements:

    - Bachelor's degree in computer science, Engineering, or a related field

    - 3-5 years of experience working with AWS MSK or Apache Kafka in a production environment

    - Strong understanding of distributed systems, real-time data processing, and cloud-based data streaming

    - Proficiency in programming languages such as Python

    - Experience with AWS services like S3, Glue, and Lambda

    - Excellent problem-solving and debugging skills

    Nice-to-Have Skills:

    - Experience with containerization technologies like Docker and Kubernetes

    - Familiarity with other messaging systems like RabbitMQ or Apache Pulsar

    - Experience with data serialization formats like Avro, Protobuf, or JSON

    - Knowledge of Snowflake or other cloud-based data warehousing solutions


  • Data Engineer

    2 weeks ago

    Only for registered members Greater Hyderabad Area

    We're looking for a skilled Data Engineer with expertise in AWS Managed Streaming for Apache Kafka (MSK) to design build and maintain high-performance data pipelines. · You'll work closely with data architects and software engineers to ensure seamless data integration and streami ...

  • Data Engineer

    3 weeks ago

    Only for registered members Greater Hyderabad Area

    We are looking for a Data Engineer – Operations to manage the reliability and performance of data pipelines across the enterprise. The ideal candidate has strong experience in cloud-based data platforms and production workflows. · Monitor and manage day-to-day operations of data ...

  • Data Engineer

    3 weeks ago

    Only for registered members Greater Hyderabad Area

    We are seeking a skilled · Data Engineer · to design, build and maintain robust cloud-based data pipelines and architectures. ...

  • Data Engineer

    3 weeks ago

    Only for registered members Greater Hyderabad Area

    At Lilly, we unite caring with discovery to make life better for people around the world. · ...

  • Data Engineer

    6 days ago

    Only for registered members Greater Hyderabad Area

    We're a global, team of innovators. Together, we harness engineering excellence and passion to co-create meaningful solutions to complex challenges. · Fostering innovation through diverse perspectives · ...

  • Tata Consultancy Services Greater Hyderabad Area

    An experienced Azure Data Factory (ADF) Developer / Lead to design develop and maintain data integration solutions using ADF Azure Synapse Analytics and other Azure data services. · ...

  • Only for registered members Greater Hyderabad Area

    +Azure Data Engineer position in Hyderabad with 8+ years of experience. · ...

  • Data Engineer 2

    2 weeks ago

    Only for registered members Greater Hyderabad Area

    About Zelis - modernizing the healthcare financial experience in the U.S. · ...

  • Only for registered members Greater Hyderabad Area

    KPI Partners is seeking an experienced Azure Data Engineer with a strong foundation in data engineering, cloud technologies, and big data analytics. · ...

  • Only for registered members Greater Hyderabad Area

    We are seeking a Principal Engineer – Data & AI to provide technical leadership across the data, reporting, and AI foundations of our planning platform PlanOS. · In this role, you will own the end-to-end data strategy supporting long-term transmission and generation planning, cap ...

  • Only for registered members Greater Hyderabad Area

    We are seeking an experienced Data Engineer - Manager to lead and oversee the development and deployment of scalable data solutions. · ...

  • Only for registered members Greater Hyderabad Area

    We are seeking a senior software engineer to join our Data Engineering team within Enterprise Functions Technology organization. · ...

  • Only for registered members Greater Hyderabad Area

    Welcome to Warner Bros. Discovery… the stuff dreams are made of. · Behind WBD's vast portfolio of iconic content and beloved brands, are the storytellers bringing our characters to life, the creators bringing them to your living rooms and the dreamers creating what's next… · ...

  • Only for registered members Greater Hyderabad Area

    The ideal candidate should hold basic qualifications including a bachelor's or master's degree in engineering, computer science, statistics, mathematics or a related quantitative field with relevant experience in data analyst roles involving substantial hands-on work with numeric ...

  • Only for registered members Greater Hyderabad Area

    +About This Role Wells Fargo is seeking a Software Engineering Senior Manager The COO Technology group delivers technology solutions for the Chief Operating Office supporting operations control executives strategic execution business continuity resiliency data services regulatory ...

  • Only for registered members Greater Hyderabad Area

    The Sr Software Engineer reports to the Sr Manager, Engineering and is accountable for designing and delivering scalable, · cloud-native solutions that power our advertising technology stack.Your New Role: · Software Development & Integration · Data Engineering · Platform Moderni ...

  • Only for registered members Greater Hyderabad Area

    We are looking for someone who can bring deep hands-on experience in building modern data pipelines on any major cloud platform (Azure,AWS,GCP) and are comfortable working with leading data-warehouse technologies such as Databricks,Snowflake,Azure SQL. · Design develop test deplo ...

  • Only for registered members Greater Hyderabad Area

    We're Salesforce, · The Customer Company, · Inspiring the future of business with AI+ Data+ CRM. · Leading with our core values, · We help companies across every industry blaze new trails and connect with customers in a whole new way. ...

  • Only for registered members Greater Hyderabad Area

    We are looking for an Associate Director to lead our Master Data Management (MDM) team. The successful candidate will have experience in data engineering, platform operations, and data infrastructure roles. · Lead and scale a global MDM and Data Engineering team. · Drive operatio ...

  • Only for registered members Greater Hyderabad Area

    FPGA RTL Design Engineer Job Summary: This is a job summary for the FPGA RTL Design Engineer position at SmartSoC Solutions. The successful candidate will be responsible for designing and bringing up FPGA platforms, debugging using on-chip analyzers, interface validation and prot ...

  • Only for registered members Greater Hyderabad Area

    We are currently looking for a Senior Application Engineer to join our Connected Gateway Team part of Global Tire Intelligence Solutions (GTIS). The Team is responsible for the hardware, firmware and industrialization of IoT gateways, · Drive all technical engineering needs in or ...

Jobs
>
Data engineer