Jobs
>
Bengaluru

    AWS Data Engineer - bangalore, India - Ilink Systems Pvt Ltd

    Ilink Systems Pvt Ltd
    Ilink Systems Pvt Ltd bangalore, India

    5 days ago

    Default job background
    Technology / Internet
    Description

    Job Description :
    AWS Data Engineer with min of 5 to 7 years of experience.

    • Collaborate with business analysts to understand and gather requirements for existing or new ETL pipelines.
    • Connect with stakeholders daily to discuss project progress and updates.
    • Work within an Agile process to deliver projects in a timely and efficient manner.
    • Design and develop Airflow DAGs to schedule and manage ETL workflows.
    • Transform SQL queries into Spark SQL code for ETL pipelines.
    • Develop custom Python functions to handle data quality and validation.
    • Write PySpark scripts to process data and perform transformations.
    • Perform data validation and ensure data accuracy and completeness by creating automated tests and implementing data validation processes
    • Run Spark jobs on AWS EMR cluster using Airflow DAGs.
    • Monitor and troubleshoot ETL pipelines to ensure smooth operation.
    • Implement best practices for data engineering, including data modeling, data warehousing, and data pipeline architecture.
    • Collaborate with other members of the data engineering team to improve processes and implement new technologies.
    • Stay up to date with emerging trends and technologies in data engineering and suggest ways to improve the team's efficiency and effectiveness.
    )
  • Decathlon India

    Data Engine

    2 weeks ago

    Decathlon India Bengaluru, India

    **Our Purpose**: *"Move people through the wonders of Sport"*About Decathlon Sports India: · Founded in 1976 in France, we have set about making the pleasure and benefit of sports available for everyone across the globe. We do that by providing world-class products both for enthu ...

  • NatWest Group

    Data Enginer

    2 weeks ago

    NatWest Group Bengaluru, Karnataka, India

    Our people work differently depending on their jobs and needs. From hybrid working to flexible hours, we have plenty of options that help our people to thrive. · This role is based in India and as such all normal working days must be carried out in India. · Join us as a Data Engi ...

  • Decathlon

    Data Engine

    2 weeks ago

    Decathlon Bengaluru, India

    Permanent contract · - Full-time · - Mid-Senior level · - BTEC Higher National Diploma, Diploma of Higher Education · - Data engineer · **Mission**: · **Our Purpose**: · **_"Move people through the wonders of Sport"_** · **About Decathlon Sports India**: · Founded in 1976 in Fran ...

  • Mercedes-Benz

    HD Map Data Collector Dev Engineer

    5 days ago

    Mercedes-Benz bangalore, India

    Tätigkeitsbereich:Forschung & Entwicklung incl. DesignFachabteilung:InfotainmentGesellschaft:Mercedes-Benz Research and Development India Private LimitedStandort:Mercedes-Benz Research and Development India, BangaloreStartdatum:sofortVeröffentlichungsdatum:..4Stellennummer:MERV J ...

  • DigitalCube Consultancy

    Azure Data Engineer

    1 week ago

    DigitalCube Consultancy Bengaluru, Karnataka, India

    **Azure Data Engineer** · **Job Type · - Full time** · **Location · - Bangalore/ Mumbai, India** · **Responsibilities**: · - Design, develop, and maintain scalable data pipelines using Azure Data Factory, Azure Databricks, and other Azure data services. · - Utilize Databricks for ...

  • Commonwealth Bank

    Data Engineer-1

    2 weeks ago

    Commonwealth Bank Bengaluru, India

    **Your business**: · The Commonwealth Bank is the leading financial institution in Australia and provides integrated financial services. · The role sits within the Bankwest Technology division. Bankwest is a subsidiary of The Commonwealth Bank, and the Bankwest Technology divisio ...

  • Deutsche Bank

    Data Engineer-2

    1 week ago

    Deutsche Bank Bengaluru, Karnataka, India

    **Data Engineer-2**: · **Job ID**:R0333521**Full/Part-Time**:Full-time**Regular/Temporary**:Regular**Listed**: **Location**:Bangalore**Position Overview**: · **Job Title - Data Engineer** · **Location - Bangalore, India** · **Role Description** · Role is an Data Engineer to manag ...

  • Mercedes-Benz Research and Development India Private Limited

    Data Engineer t9

    2 weeks ago

    Mercedes-Benz Research and Development India Private Limited Bengaluru, India

    **Aufgaben**: · - Education: Masters/Bachelors in Computer Science, Electrical / Electronics or Equivalent engineering · Good analytics skills · - Skill Requirements: · - Excellent Programming skills in Python. · - Experience with cloud technologies like Azure, AWS, GCP, public o ...

  • Kyndryl

    Data Engineer-1

    1 week ago

    Kyndryl Bengaluru, Karnataka, India

    Who We Are · At Kyndryl, we design, build, manage and modernize the mission-critical technology systems that the world depends on every day. So why work at Kyndryl? We are always moving forward - always pushing ourselves to go further in our efforts to build a more equitable, inc ...

  • Bosch Group

    Big Data Engineer 2023

    15 hours ago

    Bosch Group Bengaluru, India

    Company Description · **Bosch Global Software Technologies Private Limited** is a 100% owned subsidiary of Robert Bosch GmbH, one of the world's leading global supplier of technology and services, offering end-to-end Engineering, IT and Business Solutions. With over 22,700 associ ...

  • Black & White Business Solutions

    Data Engineer-5 to 11years

    3 days ago

    Black & White Business Solutions Bengaluru, India

    **Job Information**: · Industry · **IT Services** · *** · Province · **Karnataka** · *** · City · **Bangalore North** · *** · Postal Code · **560001** · *** · Country · **India** · Job Title:Data engineer · Years Of exp:5 to 11years · Location:Hyderabad/Pune/Coimbatore · NP:Immed ...

  • HyreFox Consultants

    Data Engineer 169368 Full-time

    3 weeks ago

    HyreFox Consultants Bengaluru, India Full time

    Build and maintain end-to-end data engineering pipelines on batch data. · - Design and implement batch data ingestion pipelines. · - Design and implement batch data transformation pipelines. · - Design and implement batch data storage solutions. · - Implement batch data governanc ...

  • Black & White Business Solutions

    Azure Data Engineer-3-10years-hyderabad

    3 weeks ago

    Black & White Business Solutions Bengaluru, India

    **Job Information**: · Industry · **IT Services** · *** · Province · **Karnataka** · *** · City · **Bangalore North** · *** · Postal Code · **560001** · *** · Country · **India** · Job Title:Azure data Bricks · Years of EXP:3 to 10Years · Location:Hyderabad · NP:30Days/Immediate ...

  • Concentrix

    Data Engineer

    4 days ago

    Concentrix Bengaluru, India

    Job Description: · Experience: 4 Years - 8 Years · Job Location: PAN India · Notice Period: Immediate/ 15 Days · Shift Timings: 03:00 PM to 12:00 AM (IST) · Skills: Data Engineering; data Pipeline; ETL, AWS (and frameworks), Pyspark/ scala; SQL & python · Job Description: · We ar ...

  • Genpact

    Data Engineer

    5 days ago

    Genpact bangalore, India

    Inviting applications for the role of Principal Consultant-Senior Data Engineer · Include optimizing data pipelines, ensuring data integrity and consistency, enhancing system resiliency where applicable, maintaining and improving data security, proactive alerting, and monitorin ...

  • Recro

    Data Engineer

    5 days ago

    Recro bangalore, India

    Experience:3+ years · Work location: Bangalore · primary_skills(Must_have) · Programming Skills: Proficiency in Python, Pyspark, and SQL is essential. · Big Data Experience: Hands-on experience with Spark and relational databases such as Postgres is required. · Orchestratio ...

  • Novo Nordisk

    Data Engineer

    5 days ago

    Novo Nordisk bangalore, India

    Job Description: · As Data engineer, you will have the opportunity: - · Applying strong technical experience building highly reliable services on managing and orchestrating a multi-petabyte scale data lake. You will have to work in a fast-paced environment. · You are responsi ...

  • Giant Eagle GCC

    Engineer, Data

    3 weeks ago

    Giant Eagle GCC , Karnataka, India

    Job Summary · As a Data Engineer on the Customer Loyalty & Experience team, you will be working on a team to bring customer-centric personalization to life. In this role, you will be empowered to develop data solutions in support of marketing analytics and data science by engagin ...

  • UNO Digital Bank

    Data Engineer

    5 days ago

    UNO Digital Bank bangalore, India

    Overview: · We are looking for an experienced data engineer to join our team. You will use various methods to transform raw data into useful data systems. Overall, you'll strive for efficiency by aligning data systems with business goals. · To succeed in this data engineering ...

  • SMARTBORN SOFTWARE CONSULTING PVT.

    Data Engineer

    2 weeks ago

    SMARTBORN SOFTWARE CONSULTING PVT. Bengaluru, India

    Role Description · This is a full-time hybrid role as a Data Engineer at SMARTBORN SOFTWARE CONSULTING PVT.LTD. The Data Engineer will be responsible for day-to-day tasks related to data engineering, including data modeling, Extract Transform Load (ETL) development, data warehous ...