Jobs
>
Data Engineer
>
Gurgaon

    Data Engineer - Gurgaon/Gurugram, India - BRISKWIN IT SOLUTIONS PRIVATE LIMITED

    BRISKWIN IT SOLUTIONS PRIVATE LIMITED
    BRISKWIN IT SOLUTIONS PRIVATE LIMITED Gurgaon/Gurugram, India

    6 days ago

    Default job background
    permanent Technology / Internet
    Description

    Position : ETL-Data Engineer

    Location : Gurgaon(Hybrid)

    Experience : 6 to 12 Years

    F2F Interview at Gurgaon on 9th March

    Skills Combination :

    ETL - Databricks + Pyspark + (SQL) or BTL - SQL + (Python Basics + Databricks Basics) + (DBT Basics - Nice to have)

    - DWH knowledge is mandatory for both ETL/BTL.

    Job Description :

    Responsibilities :

    - Design, Develop, and maintain ETL pipelines using Pyspark in Azure Databricks using delta tables.

    - Create build from Github and release pipeline for Ingestion and Databricks using Azure Devops / Harness

    - Monitor Performance of ETL Jobs, resolve any issue that arose and improve the performance metrics as needed.

    - Diagnose system performance issue related to data processing and implement solution to address them.

    - Collaborate with other teams to ensure successful integration of data pipelines into larger system architecture requirement.

    - Maintain integrity and quality across all pipelines and environments.

    - Understand and follow secure coding practice to make sure code is not vulnerable

    Skills :

    - Should have Strong background in Software development with experience in ingest, transform and store data from large datasets using Pyspark in Azure Databricks with strong knowledge on distributed computing concepts.

    - Must have hands on experience in designing and developing ETL Pipelines in Pyspark in Azure Databricks with strong python scripting exposure like list comprehensions, Dictionary variables etc.

    - Must have minimum 5 years of exposure and good proficiency in data warehousing concepts.

    - Proficient in SQl and database Design concepts.

    - Hands on experience with good proficiency in Delta table and delta file operations like merge, Insert override, Partition overrides etc.

    - Hands on Experience in CICD in Azure DevOps/Harness and ADF/Stone branch for orchestration.

    - Knowledge of Azure cloud computing platform with Azure Synapse, ADLS.

    - Knowledge on GitHub and build management.

    - Passion for data and experience working within a data driven organization

    - Excellent presentation, communication (oral & written), and relationship building skills, across all levels of management

    )
  • Layer7 SAPI de CV

    Data Engineer

    3 days ago

    Layer7 SAPI de CV New Delhi, India

    Job DescriptionThis is a remote position. · • Diseñar, crear y mantener canalizaciones de datos por lotes o en tiempo real en producción. · • Mantener y optimizar la infraestructura de datos necesaria para una extracción, transformación y carga precisas de datos de una amplia var ...

  • Teleparty

    Data Engineer

    1 day ago

    Teleparty Gurugram, India

    Teleparty is hiring Data Engineers · Join Teleparty, a premium remote entertainment service leading the charge in making social TV a global cultural phenomenon bigger than the movies. With over 10 million streamers who have installed our Netflix focused browser extension - Telepa ...

  • Acuity Knowledge Partners

    Data Engineer

    1 day ago

    Acuity Knowledge Partners Gurugram, India

    Opportunity- Data Engineer (Associate/ Senior Associate) · Location- Gurugram (Hybrid) · "Immediate joiners are highly preferred" · Key Responsibilities: · Partner with data strategy and sourcing team on data requirements to design data pipelines and delivery structures. · Engage ...

  • EXL

    Data Engineer

    4 days ago

    EXL Gurugram, India

    Role Overview: We are looking for a go-getter person who can help support: o Data strategies to meet the demands of business requirements · Technical requirements of the organizational data needs from diverse teams · Data architecture, models and go-forward data solutions for v ...

  • Avrio

    Data Engineer

    4 days ago

    Avrio Gurugram, India

    Overview · Avrio is an international climate tech startup leveraging advancements in AI to decarbonize the real estate industry which is responsible for around 39% of global carbon emissions. As a Machine Learning Engineer at Avrio, you will play a crucial role in developing AI-p ...

  • Impetus

    Data Engineer

    4 days ago

    Impetus Gurugram, India

    About Impetus · Impetus Technologies is a digital engineering company focused on delivering expert services and products to help enterprises achieve their transformation goals. We solve the analytics, AI, and cloud puzzle, enabling businesses to drive unmatched innovation and gro ...

  • Impetus

    Data Engineer

    2 days ago

    Impetus Gurugram, India

    3-7 years of IT experience range is preferred. · Worked on Hadoop Ecosystem · Good hands on experience on Spark and Hive · Able to effectively use GCP managed services e.g. Dataproc, Dataflow, pub/sub, Cloud functions, Big Query, GCS - At least 4 of these Services. · Good to ha ...

  • EXL

    Data Engineer

    5 days ago

    EXL Gurugram, India

    Job Location: Bangalore/Gurgaon · Shift Timing: 12:00PM IST – 10:30 PM IST · Experience: 3+ years · Job Summary: · Data Engineer (DE) is responsible for designing, developing, and maintaining data assets and data related products by liaising with multiple stakeholders. · Responsi ...

  • Saarthee

    Data Engineer

    23 hours ago

    Saarthee Gurugram, India permanent

    Position Summary : · In the Data Engineer role, you will assist on data retrieval from multiple source systems, data processing and cleansing. You will be responsible for constructing automated data pipelines and updating the serving layer for analytics and insights. · Your Rol ...

  • Impetus

    Data Engineer

    5 days ago

    Impetus Gurugram, India

    About Impetus · Impetus Technologies is a digital engineering company focused on delivering expert services and products to help enterprises achieve their transformation goals. We solve the analytics, AI, and cloud puzzle, enabling businesses to drive unmatched innovation and gro ...

  • True Tech Professionals Private Limited

    Data Engineer

    23 hours ago

    True Tech Professionals Private Limited Gurugram, India permanent

    Location : Gurgaon (Hybrid Mode) · Experience : 5 years and above. (Less than 5 years will not be considered) · Immediate Joiners Preferred (Notice Period: 7 to 10 days) · We are seeking a skilled Senior Data Engineer to join our dynamic team. The ideal candidate should have a st ...

  • HuQuo Consulting Pvt. Ltd.

    Data Engineer

    23 hours ago

    HuQuo Consulting Pvt. Ltd. Gurgaon/Gurugram, India permanent

    MIS team is seeking a GCP Data Engineer to create, deliver, and support custom data products, as well as enhance/expand team capabilities. They will work on analyzing and manipulating large datasets supporting the enterprise by activating data assets to support Enabling Platforms ...

  • HuQuo Consulting Pvt. Ltd.

    Data Engineer

    23 hours ago

    HuQuo Consulting Pvt. Ltd. Gurugram, India permanent

    Role & Responsibilities Overview : · - A seasoned data team member with a good grasp of both business and technical aspects. · Good familiarity with data stack · - Interact with the other members of the data governance team, business teams to understand requirements and also col ...

  • Upnotch Consulting

    Data Engineer

    1 day ago

    Upnotch Consulting Gurugram, India

    Position Summary : · In the Data Engineer role, you will assist on data retrieval from multiple source systems, data processing and cleansing. You will be responsible for constructing automated data pipelines and updating the serving layer for analytics and insights. · Your Role ...

  • NAB

    Data Engineer

    4 days ago

    NAB Gurugram, India

    Purpose · To maximise the effective use and value of Marketing and Enterprise data assets by delivering on a strategic data management roadmap through a combination of: · oThe implementation of a structured and comprehensive approach to data management and data governance within ...

  • HuQuo Consulting Pvt. Ltd.

    Data Engineer

    23 hours ago

    HuQuo Consulting Pvt. Ltd. Gurgaon/Gurugram, India permanent

    Job Description : · We are looking for a go getter person who can define : · - Analytic strategies to meet the demands of business requirements · - Technical requirements of the analytic solutions · - Data requirements of the analytic solution processes · - The person will be par ...

  • TOTLRPO

    Data Engineer

    23 hours ago

    TOTLRPO Gurugram, India permanent

    Qualifications : · a. 11+ years of overall technology experience that includes at least 4+ years of hands-on software development, data engineering, and systems architecture. · b. 4+ years of experience with Data Lake Infrastructure, Data Warehousing, and Data Analytics tools. · ...

  • Paisabazaar

    Data Engineer

    23 hours ago

    Paisabazaar Gurugram, India permanent

    Job Description : · Qualifications for Data Engineer : · 3+ Years of experience in building and optimizing 'big data' solutions required to fulfill business and technology requirements. · 3+ years of technical expertise in areas of design and implementation using big data technol ...

  • True Tech Professionals Private Limited

    Data Engineer

    1 day ago

    True Tech Professionals Private Limited Gurugram, India permanent

    Data Engineer - Snowflake · Location : Gurgaon (Hybrid) · Summary : · We are seeking a skilled Data Engineer with expertise in Snowflake to join our dynamic team. The ideal candidate will have a solid understanding of data governance principles and extensive experience in develop ...

  • HuQuo Consulting Pvt. Ltd.

    Data Engineer

    23 hours ago

    HuQuo Consulting Pvt. Ltd. Gurugram, India permanent

    Job Description : · Role Overview : · We are looking for a go-getter person who can define : · - Data strategies to meet the demands of business requirements · - Technical requirements of the organizational data needs from diverse teams · - Data architecture, models and go-forwar ...