Jobs
>
Bengaluru

    Data Engineer - Bangalore, India - ARR Recruitment Solutions

    ARR Recruitment Solutions
    ARR Recruitment Solutions Bangalore, India

    1 day ago

    Default job background
    permanent Technology / Internet
    Description

    Job Description :


    We are looking for a highly skilled Senior Data Engineer with extensive experience in data integration, processing, and application development for handling large-scale data sets measured in Terabytes from multiple sources.


    • The ideal candidate will have a strong background in AWS services, particularly Lambda, EMR, and Glue, along with advanced proficiency in SQL and Python.
    • The candidate should be adept at building secure, scalable, and robust data solutions and should be comfortable working in selforganizing Agile teams with minimal supervision.

    Responsibilities :

    • Develop and maintain data processing pipelines to integrate and process large volumes of data from diverse sources.
    • Implement product features that meet high standards of security, scalability, and reliability.
    • Collaborate with crossfunctional teams to understand requirements and design efficient data solutions.
    • Take ownership of code quality and ensure that implemented features and bug fixes work seamlessly at cloud scale.
    • Work within selforganizing Agile teams to deliver features and enhancements on schedule.
    • Document code, processes, and best practices to facilitate knowledge sharing and maintainability.

    Mandatory Skills :

    AWS Services :
    Proficiency in AWS services such as Lambda, EMR, and Glue for building scalable data solutions.

    SQL Expertise :
    Advanced knowledge of SQL for data manipulation, querying, and analysis.

    Python Proficiency :
    Deep understanding of Python programming for data processing and application development.

    Big Data Processing :
    Experience with tools like Pyspark for processing and analyzing large-scale data sets.

    Terabytes :
    Experience working with very large-scale data sets measured in Terabytes.

    Additional Keywords :
    Familiarity with concepts like map reduce, list comprehensions, and Python lambda functions.


    Good to have :

    Tools :
    Experience with project management tools such as JIRA, version control systems like Bitbucket, and documentation tools like Confluence.

    AWS Security :
    Understanding of security best practices in AWS, including API Gateway and IAM.

    Design Patterns :
    Knowledge of software design patterns for building scalable and maintainable data solutions.

    Alternatives :
    Familiarity with alternative tools such as Azure Data Factory, Talend, and Hadoop.

    )
  • Decathlon India

    Data Engine

    3 days ago

    Decathlon India Bengaluru, India

    **Our Purpose**: *"Move people through the wonders of Sport"*About Decathlon Sports India: · Founded in 1976 in France, we have set about making the pleasure and benefit of sports available for everyone across the globe. We do that by providing world-class products both for enthu ...

  • NatWest Group

    Data Enginer

    2 days ago

    NatWest Group Bengaluru, Karnataka, India

    Our people work differently depending on their jobs and needs. From hybrid working to flexible hours, we have plenty of options that help our people to thrive. · This role is based in India and as such all normal working days must be carried out in India. · Join us as a Data Engi ...

  • Decathlon

    Data Engine

    3 days ago

    Decathlon Bengaluru, India

    Permanent contract · - Full-time · - Mid-Senior level · - BTEC Higher National Diploma, Diploma of Higher Education · - Data engineer · **Mission**: · **Our Purpose**: · **_"Move people through the wonders of Sport"_** · **About Decathlon Sports India**: · Founded in 1976 in Fran ...

  • Commonwealth Bank

    Data Engineer-1

    4 days ago

    Commonwealth Bank Bengaluru, India

    **Your business**: · The Commonwealth Bank is the leading financial institution in Australia and provides integrated financial services. · The role sits within the Bankwest Technology division. Bankwest is a subsidiary of The Commonwealth Bank, and the Bankwest Technology divisio ...

  • HyreFox Consultants

    Data Engineer 169368 Full-time

    1 week ago

    HyreFox Consultants Bengaluru, India Full time

    Build and maintain end-to-end data engineering pipelines on batch data. · - Design and implement batch data ingestion pipelines. · - Design and implement batch data transformation pipelines. · - Design and implement batch data storage solutions. · - Implement batch data governanc ...

  • Black & White Business Solutions

    Azure Data Engineer-3-10years-hyderabad

    6 days ago

    Black & White Business Solutions Bengaluru, India

    **Job Information**: · Industry · **IT Services** · *** · Province · **Karnataka** · *** · City · **Bangalore North** · *** · Postal Code · **560001** · *** · Country · **India** · Job Title:Azure data Bricks · Years of EXP:3 to 10Years · Location:Hyderabad · NP:30Days/Immediate ...

  • UNO Digital Bank

    Data Engineer

    6 days ago

    UNO Digital Bank Bengaluru, India

    Overview: · We are looking for an experienced data engineer to join our team. You will use various methods to transform raw data into useful data systems. Overall, you'll strive for efficiency by aligning data systems with business goals. · To succeed in this data engineering po ...

  • Informatica

    Data Engineer

    1 week ago

    Informatica Bengaluru, India

    Build Your Career at Informatica · We're looking for a diverse group of collaborators who believe data has the power to improve society. Adventurous minds who value solving some of the world's most challenging problems. Here, employees are encouraged to push their boldest ideas f ...

  • SMARTBORN SOFTWARE CONSULTING PVT.

    Data Engineer

    2 days ago

    SMARTBORN SOFTWARE CONSULTING PVT. Bengaluru, India

    Role Description · This is a full-time hybrid role as a Data Engineer at SMARTBORN SOFTWARE CONSULTING PVT.LTD. The Data Engineer will be responsible for day-to-day tasks related to data engineering, including data modeling, Extract Transform Load (ETL) development, data warehous ...

  • Quantum Labs

    Data Engineer

    5 days ago

    Quantum Labs Bengaluru, India

    Company Description · Quantum Labs is a product and technology consulting studio specializing in web, mobile, and AI applications. With a team of experienced professionals, we are committed to delivering high-quality services that meet the unique needs of our clients. At Quantum ...

  • Joveo

    Data Engineer

    6 days ago

    Joveo Bengaluru, India

    We are looking for talented Data Engineers who are passionate about data engineering and have strong experience in building scalable data pipelines. As a Data Engineer at Joveo, you will play a leading role in designing and building datasets that power analytics for teams across ...

  • TEKsystems

    Data Engineer

    2 days ago

    TEKsystems Bengaluru, India

    Job Description: · We are seeking a skilled and motivated individual to join our team as a Snowflake Data Engineer with expertise in Python development. As a key member of our data team, you will play a crucial role in designing, implementing, and optimizing data pipelines withi ...

  • Razorpay

    Data Engineer

    3 days ago

    Razorpay Bengaluru, India

    The Role: · We are looking for a savvy Data Engineer to join our growing team, responsible for expanding and optimizing our data and data pipeline architecture, as well as optimizing data flow. The ideal candidate is an experienced data pipeline builder and data wrangler who enjo ...

  • Ascendion

    Data Engineer

    6 days ago

    Ascendion Bengaluru, India

    Job Title: Data Engineer/ Lead · Duration: Full Time · Location: Bengaluru, Hyderabad, Chennai, Pune (Hyrbrid) · NOTE: Looking for Immediate Joiners ( 2-3 weeks notice) · Proficient in Azure Cloud services (or GCP is Ok) for data engineering tasks. · Familiarity with Kubeflow, wi ...

  • Tavant

    Data Engineer

    1 week ago

    Tavant Bengaluru, India

    With 24+ years of experience building innovative digital products and solutions, Tavant provides impactful results to its customers. It has been the frontrunner in driving digital innovation and tech-enabled transformation across a wide range of industries such as Fintech, Manufa ...

  • Datafoundry

    Data Engineer

    1 week ago

    Datafoundry Bengaluru, India

    Job Role - Data Engineer · Experience: 4-7 years · Location – Bangalore / Hyderabad / Visakhapatnam · Work Mode – On-site / Work from office (5 working days) · About Datafoundry AI: · We're Datafoundry AI, a dedicated team of data scientists, life sciences experts, and technol ...

  • Trigent Software - Professional Services

    Sr Data Engineer/Data Engineer

    1 week ago

    Trigent Software - Professional Services Bengaluru, India

    Senior Data Engineer (5+ Years) / Data Engineer (3+): · Experience working with distributed technology tools for developing Batch and Streaming pipelines using · SQL, Spark, PySpark, · Airflow [3+ years], · Spark with Scala (optional). · Able to write code which is optimized ...

  • JRD Systems

    Data Engineer

    1 day ago

    JRD Systems Bengaluru, India

    Role : Data Engineer - AWS and Oracle Expert · Job Summary: · We are seeking a highly skilled and experienced Data Engineer with expertise in data development in AWS and Oracle. The ideal candidate will have a minimum of 5 years of experience in data engineering, with a strong fo ...

  • Giant Eagle GCC

    Engineer, Data

    4 days ago

    Giant Eagle GCC , Karnataka, India

    Job Summary · As a Data Engineer on the Customer Loyalty & Experience team, you will be working on a team to bring customer-centric personalization to life. In this role, you will be empowered to develop data solutions in support of marketing analytics and data science by engagin ...

  • Course5i

    Data Engineer

    5 days ago

    Course5i Bengaluru, India

    The Data Engineer will be responsible for designing, building, and maintaining data pipelines and infrastructure that enable efficient and accurate data processing. · The Data Engineer will work closely with data scientists, analysts, and project teams to ensure data is accessibl ...