Jobs
>
Bengaluru

    Senior Data Engineer - Bengaluru, India - Quantiphi

    Quantiphi
    Default job background
    Technology / Internet
    Description

    Role: Senior Data Engineer

    Experience Level: 3 to 6 Years

    Work location: Mumbai, Bangalore & Trivandrum

    Role & Responsibilities:

    ● Support the planning and implementation of data flow design, provide sizing and configuration assistance.

    ● Assisting the Solution Architects on programs for transformations and modernizations of data solutions using Azure cloud data technologies.

    ● Design and Build Azure Data Pipelines and Data StreamsDesign and build a hybrid data solution using a combination of on-premise and in-cloud services.

    ● Diagnose and troubleshoot complex distributed systems problems and develop solutions with a significant impact on our massive scale.

    ● Build tools to ingest and process terabyte-scale data on a daily basis.

    ● Communicate with a wide set of teams, including product owners, business analysts, data and enterprise architects, platform engineers, and cloud vendors, etc.

    ● Compilation of detailed design documents, technical specification documents, and test plans as required.

    ● Independently manage development tasks as per technical specification documents, prod deployment, post-prod support, etc

    ● Rewriting, validating and optimizing codes.

    ● Coordinate with business and support teams on testing and migration activities.

    Skills expectation:

    Mandatory – PySpark, Apache Spark, DataBricks, SQL.

    ● Data Factory and Analysis Service and/or Synapse is good to have.

    ● Expertise in SQL writing and performance optimization and tuning.

    ● Good to have exposure on Azure cloud

    ● Experience in Data migration of legacy systems.

    ● Knowledge of version control systems, build automation and CI/CD tools and frameworks.

    ● Experience with operating system internals, file systems, disk/storage technologies, and storage Protocol.


  • NatWest Group

    Data Enginer

    2 days ago


    NatWest Group Bengaluru, Karnataka, India

    Our people work differently depending on their jobs and needs. From hybrid working to flexible hours, we have plenty of options that help our people to thrive. · This role is based in India and as such all normal working days must be carried out in India. · Join us as a Data Engi ...

  • Decathlon

    Data Engine

    3 days ago


    Decathlon Bengaluru, India

    Permanent contract · - Full-time · - Mid-Senior level · - BTEC Higher National Diploma, Diploma of Higher Education · - Data engineer · **Mission**: · **Our Purpose**: · **_"Move people through the wonders of Sport"_** · **About Decathlon Sports India**: · Founded in 1976 in Fran ...

  • Decathlon India

    Data Engine

    3 days ago


    Decathlon India Bengaluru, India

    **Our Purpose**: *"Move people through the wonders of Sport"*About Decathlon Sports India: · Founded in 1976 in France, we have set about making the pleasure and benefit of sports available for everyone across the globe. We do that by providing world-class products both for enthu ...

  • Commonwealth Bank

    Data Engineer-1

    4 days ago


    Commonwealth Bank Bengaluru, India

    **Your business**: · The Commonwealth Bank is the leading financial institution in Australia and provides integrated financial services. · The role sits within the Bankwest Technology division. Bankwest is a subsidiary of The Commonwealth Bank, and the Bankwest Technology divisio ...


  • HyreFox Consultants Bengaluru, India Full time

    Build and maintain end-to-end data engineering pipelines on batch data. · - Design and implement batch data ingestion pipelines. · - Design and implement batch data transformation pipelines. · - Design and implement batch data storage solutions. · - Implement batch data governanc ...


  • Black & White Business Solutions Bengaluru, India

    **Job Information**: · Industry · **IT Services** · *** · Province · **Karnataka** · *** · City · **Bangalore North** · *** · Postal Code · **560001** · *** · Country · **India** · Job Title:Azure data Bricks · Years of EXP:3 to 10Years · Location:Hyderabad · NP:30Days/Immediate ...


  • Trigent Software - Professional Services Bengaluru, India

    Senior Data Engineer (5+ Years) / Data Engineer (3+): · Experience working with distributed technology tools for developing Batch and Streaming pipelines using · SQL, Spark, PySpark, · Airflow [3+ years], · Spark with Scala (optional). · Able to write code which is optimized ...

  • JRD Systems

    Data Engineer

    1 day ago


    JRD Systems Bengaluru, India

    Role : Data Engineer - AWS and Oracle Expert · Job Summary: · We are seeking a highly skilled and experienced Data Engineer with expertise in data development in AWS and Oracle. The ideal candidate will have a minimum of 5 years of experience in data engineering, with a strong fo ...

  • Course5i

    Data Engineer

    4 days ago


    Course5i Bengaluru, India

    The Data Engineer will be responsible for designing, building, and maintaining data pipelines and infrastructure that enable efficient and accurate data processing. · The Data Engineer will work closely with data scientists, analysts, and project teams to ensure data is accessibl ...

  • Joveo

    Data Engineer

    6 days ago


    Joveo Bengaluru, India

    We are looking for talented Data Engineers who are passionate about data engineering and have strong experience in building scalable data pipelines. As a Data Engineer at Joveo, you will play a leading role in designing and building datasets that power analytics for teams across ...

  • Sun Life

    Data Engineer

    1 week ago


    Sun Life Bengaluru, India

    Key Responsibilities · This is a position for AWS data engineer typically works on development, implementing, and maintaining data solutions on the Amazon Web Services (AWS) platform. · Working with the Subject Matter Experts and Business Analysts to grasp the best knowledge of e ...

  • Fractal

    Data Engineering

    1 week ago


    Fractal Bengaluru, India

    We are seeking a talented Lead Data Engineering Manager to support a Fortune 500 Technology Client. The ideal candidate will have 7-12 years of experience in setting up & implementing digital analytics (Adobe Analytics). leading data modeling and ETL development, APIs that serve ...

  • Ascendion

    Data Engineer

    5 days ago


    Ascendion Bengaluru, India

    Job Title: Data Engineer/ Lead · Duration: Full Time · Location: Bengaluru, Hyderabad, Chennai, Pune (Hyrbrid) · NOTE: Looking for Immediate Joiners ( 2-3 weeks notice) · Proficient in Azure Cloud services (or GCP is Ok) for data engineering tasks. · Familiarity with Kubeflow, wi ...

  • SMARTBORN SOFTWARE CONSULTING PVT.

    Data Engineer

    2 days ago


    SMARTBORN SOFTWARE CONSULTING PVT. Bengaluru, India

    Role Description · This is a full-time hybrid role as a Data Engineer at SMARTBORN SOFTWARE CONSULTING PVT.LTD. The Data Engineer will be responsible for day-to-day tasks related to data engineering, including data modeling, Extract Transform Load (ETL) development, data warehous ...

  • Giant Eagle GCC

    Engineer, Data

    4 days ago


    Giant Eagle GCC , Karnataka, India

    Job Summary · As a Data Engineer on the Customer Loyalty & Experience team, you will be working on a team to bring customer-centric personalization to life. In this role, you will be empowered to develop data solutions in support of marketing analytics and data science by engagin ...

  • Quantum Labs

    Data Engineer

    4 days ago


    Quantum Labs Bengaluru, India

    Company Description · Quantum Labs is a product and technology consulting studio specializing in web, mobile, and AI applications. With a team of experienced professionals, we are committed to delivering high-quality services that meet the unique needs of our clients. At Quantum ...

  • TEKsystems

    Data Engineer

    5 days ago


    TEKsystems Bengaluru, India

    Experience – 4 to 10 years · Requirement- · Lead the technical team, help, and support junior developers in project work. · Expert level in Azure Data-bricks with SQL · Expert level in Pyspark programming. · Good understanding in Azure Data Factory (ADF) · Good understanding on D ...

  • UNO Digital Bank

    Data Engineer

    6 days ago


    UNO Digital Bank Bengaluru, India

    Overview: · We are looking for an experienced data engineer to join our team. You will use various methods to transform raw data into useful data systems. Overall, you'll strive for efficiency by aligning data systems with business goals. · To succeed in this data engineering po ...

  • Decathlon Sports India

    Data Engineer

    1 week ago


    Decathlon Sports India Bengaluru, India

    About Decathlon Sports India: · Founded in 1976 in France, we have set about making the pleasure and benefit of sports available for everyone across the globe. We do that by providing world-class products both for enthusiastic beginners as well as passionate professionals at extr ...

  • Recro

    Data Engineer

    2 days ago


    Recro Bengaluru, India

    Experience:3+ years · Work location: Bangalore · primary_skills(Must_have) · Programming Skills: Proficiency in Python, Pyspark, and SQL is essential. · Big Data Experience: Hands-on experience with Spark and relational databases such as Postgres is required. · Orchestration To ...