Jobs
>
Gurgaon

    ETL Data Engineer - Gurgaon/Gurugram, India - Coders Brain Pvt Ltd

    Coders Brain Pvt Ltd
    Coders Brain Pvt Ltd Gurgaon/Gurugram, India

    1 week ago

    Default job background
    permanent Technology / Internet
    Description

    Job Description:
    ETL - Data Design, Develop and maintain ETL pipelines using Pyspark in Azure Databricks using delta tables.

    • Create build from Github and release pipeline for Ingestion and Databricks using Azure Devops / Harness
    • Monitor Performance of ETL Jobs, resolve any issue that arose and improve the performance metrics as needed.
    • Diagnose system performance issue related to data processing and implement solution to address them.
    • Collaborate with other teams to ensure successful integration of data pipelines into larger system architecture requirement.
    • Maintain integrity and quality across all pipelines and environments.
    • Understand and follow secure coding practice to make sure code is not vulnerable

    Skills:

    • Should have Strong background in Software development with experience in ingest, transform and store data from large datasets using Pyspark in Azure Databricks with strong knowledge on distributed computing concepts.
    • Must have hands on experience in designing and developing ETL Pipelines in Pyspark in Azure Databricks with strong python scripting exposure like list comprehensions, Dictionary variables etc.
    • Must have minimum 5 years of exposure and good proficiency in data warehousing concepts.
    • Proficient in SQl and database Design concepts.
    • Hands on experience with good proficiency in Delta table and delta file operations like merge, Insert override, Partition overrides etc.
    • Hands on Experience in CICD in Azure DevOps/Harness and ADF/Stone branch for orchestration.
    • Knowledge of Azure cloud computing platform with Azure Synapse, ADLS.
    • Knowledge on GitHub and build management.
    • Passion for data and experience working within a data driven organization
    • Excellent presentation, communication (oral & written), and relationship building skills, across all levels of management
    )
  • Layer7 SAPI de CV

    Data Engineer

    4 days ago

    Layer7 SAPI de CV New Delhi, India

    Job DescriptionThis is a remote position. · • Diseñar, crear y mantener canalizaciones de datos por lotes o en tiempo real en producción. · • Mantener y optimizar la infraestructura de datos necesaria para una extracción, transformación y carga precisas de datos de una amplia var ...

  • Teleparty

    Data Engineer

    2 days ago

    Teleparty Gurugram, India

    Teleparty is hiring Data Engineers · Join Teleparty, a premium remote entertainment service leading the charge in making social TV a global cultural phenomenon bigger than the movies. With over 10 million streamers who have installed our Netflix focused browser extension - Telepa ...

  • EXL

    Data Engineer

    4 days ago

    EXL Gurugram, India

    Role Overview: We are looking for a go-getter person who can help support: o Data strategies to meet the demands of business requirements · Technical requirements of the organizational data needs from diverse teams · Data architecture, models and go-forward data solutions for v ...

  • Avrio

    Data Engineer

    5 days ago

    Avrio Gurugram, India

    Overview · Avrio is an international climate tech startup leveraging advancements in AI to decarbonize the real estate industry which is responsible for around 39% of global carbon emissions. As a Machine Learning Engineer at Avrio, you will play a crucial role in developing AI-p ...

  • CodeChavo

    Data Engineer

    13 hours ago

    CodeChavo Gurugram, India

    Company Description · CodeChavo is an IT consulting and software development company that helps leading brands and startups with quality product engineering, digital transformation, and clean code. We specialize in helping companies outsource their digital projects and build qual ...

  • Battery Smart

    Data Engineer

    13 hours ago

    Battery Smart Gurugram, India

    Position: Data Engineer · Experience – 2-3 years · Education – Graduation in any relevant field - Computer Science, Statistics, Mathematics, or Engineering from Tier-1 Institute · Location – Gurugram, Haryana · Roles & responsibilities - · Collaborate closely with the data analyt ...

  • Upnotch Consulting

    Data Engineer

    2 days ago

    Upnotch Consulting Gurugram, India

    Position Summary : · In the Data Engineer role, you will assist on data retrieval from multiple source systems, data processing and cleansing. You will be responsible for constructing automated data pipelines and updating the serving layer for analytics and insights. · Your Role ...

  • Saarthee

    Data Engineer

    1 day ago

    Saarthee Gurugram, India permanent

    Position Summary : · In the Data Engineer role, you will assist on data retrieval from multiple source systems, data processing and cleansing. You will be responsible for constructing automated data pipelines and updating the serving layer for analytics and insights. · Your Rol ...

  • Impetus

    Data Engineer

    5 days ago

    Impetus Gurugram, India

    About Impetus · Impetus Technologies is a digital engineering company focused on delivering expert services and products to help enterprises achieve their transformation goals. We solve the analytics, AI, and cloud puzzle, enabling businesses to drive unmatched innovation and gro ...

  • Impetus

    Data Engineer

    6 days ago

    Impetus Gurugram, India

    About Impetus · Impetus Technologies is a digital engineering company focused on delivering expert services and products to help enterprises achieve their transformation goals. We solve the analytics, AI, and cloud puzzle, enabling businesses to drive unmatched innovation and gro ...

  • True Tech Professionals Private Limited

    Data Engineer

    2 days ago

    True Tech Professionals Private Limited Gurugram, India permanent

    Data Engineer - Snowflake · Location : Gurgaon (Hybrid) · Summary : · We are seeking a skilled Data Engineer with expertise in Snowflake to join our dynamic team. The ideal candidate will have a solid understanding of data governance principles and extensive experience in develop ...

  • Impetus

    Data Engineer

    3 days ago

    Impetus Gurugram, India

    3-7 years of IT experience range is preferred. · Worked on Hadoop Ecosystem · Good hands on experience on Spark and Hive · Able to effectively use GCP managed services e.g. Dataproc, Dataflow, pub/sub, Cloud functions, Big Query, GCS - At least 4 of these Services. · Good to ha ...

  • HuQuo Consulting Pvt. Ltd.

    Data Engineer

    6 hours ago

    HuQuo Consulting Pvt. Ltd. Gurgaon/Gurugram, India permanent

    Job Description : · Role Overview : · We are looking for a go-getter person who can define : · - Data strategies to meet the demands of business requirements · - Technical requirements of the organizational data needs from diverse teams · - Data architecture, models and go-forwar ...

  • EXL

    Data Engineer

    6 days ago

    EXL Gurugram, India

    Job Location: Bangalore/Gurgaon · Shift Timing: 12:00PM IST – 10:30 PM IST · Experience: 3+ years · Job Summary: · Data Engineer (DE) is responsible for designing, developing, and maintaining data assets and data related products by liaising with multiple stakeholders. · Responsi ...

  • Acuity Knowledge Partners

    Data Engineer

    2 days ago

    Acuity Knowledge Partners Gurugram, India

    Opportunity- Data Engineer (Associate/ Senior Associate) · Location- Gurugram (Hybrid) · "Immediate joiners are highly preferred" · Key Responsibilities: · Partner with data strategy and sourcing team on data requirements to design data pipelines and delivery structures. · Engage ...

  • Huquo Consulting

    Data Engineer

    1 day ago

    Huquo Consulting Gurugram, India permanent

    Role : Data Engineer · Location : Gurgaon · Designation : AM- AVP (as per interview performance & EXL fitment) · Work Timings : 1pm- 10pm · Role Overview : · We are looking for a go getter person who can define : · 1. Analytic strategies to meet the demands of business requiremen ...

  • TOTLRPO

    Data Engineer

    1 day ago

    TOTLRPO Gurugram, India permanent

    Qualifications : · a. 11+ years of overall technology experience that includes at least 4+ years of hands-on software development, data engineering, and systems architecture. · b. 4+ years of experience with Data Lake Infrastructure, Data Warehousing, and Data Analytics tools. · ...

  • HuQuo Consulting Pvt. Ltd.

    Data Engineer

    1 day ago

    HuQuo Consulting Pvt. Ltd. Gurgaon/Gurugram, India permanent

    MIS team is seeking a GCP Data Engineer to create, deliver, and support custom data products, as well as enhance/expand team capabilities. They will work on analyzing and manipulating large datasets supporting the enterprise by activating data assets to support Enabling Platforms ...

  • Huquo Consulting

    Data Engineer

    2 days ago

    Huquo Consulting Gurugram, India

    EXL (NASDAQ:EXLS) is a leading operations management and analytics company that helps businesses enhance growth and profitability in the face of relentless competition and continuous disruption. Using our proprietary, award-winning Business EXLerator Framework- , which integrates ...

  • True Tech Professionals Private Limited

    Data Engineer

    6 hours ago

    True Tech Professionals Private Limited Gurgaon/Gurugram, India permanent

    Location : Gurgaon (Hybrid Mode) · Experience : 5 years and above. (Less than 5 years will not be considered) · Immediate Joiners Preferred (Notice Period: 7 to 10 days) · We are seeking a skilled Senior Data Engineer to join our dynamic team. The ideal candidate should have a st ...