Jobs
>
Data Engineer
>
Gurgaon

    Data Engineer - Gurgaon, India - EXL

    EXL
    EXL Gurgaon, India

    14 hours ago

    EXL background
    Description

    Job Location:
    Bangalore/Gurgaon

    Shift Timing:
    12:00PM IST – 10:30 PM IST

    Experience:
    3+ years


    Job Summary:


    Data Engineer (DE) is responsible for designing, developing, and maintaining data assets and data related products by liaising with multiple stakeholders.


    Responsibilities:

    • Collaborate with project stakeholders (client) to identify product and technical requirements. Conduct analysis to determine integration needs.
    Use different data warehousing concepts to build a data warehouse for reporting purpose.

    • Build data pipelines to ingest and transform the data into our Data platform.
    • Apply best approaches for large scale data movement, capture data changes and apply incremental data load strategies.
    • Develop, implement, and tune large-scale distributed systems and pipelines that process large volume of data.
    Assist Data Science / Modelling teams in setting up data pipelines & monitoring daily jobs.
    Develop and test ETL components to high standards of data quality and act as hands-on development lead.

    Oversee and contribute to the creation and maintenance of relevant data artifacts (data lineages, source to target mappings, high level designs, interface agreements, etc.).

    Ensuring that developer responsibilities are being met by mentoring, reviewing code and test plans, verifying that design best practices as well as coding and architectural guidelines, standards, and frameworks.

    Work with stakeholders to understand the data requirements to design, develop, and maintain complex ETL processes.
    Create the data integration and data diagram documentation.

    Qualifications (Must have):
    3+ years as Data Engineer with proficiency in SQL, Python & PySpark programming.
    Strong knowledge on Databricks and related services/functionalities and how to utilize them across the DE & Analytics spectrum
    Strong knowledge on Hadoop, Hive, Databricks and RDBMS like Oracle, Teradata, SQL server etc

    Expectation is to write SQL to query metadata and tables from different data management system such as, Oracle, Hive, Databricks and Greenplum.

    Familiarity with big data technologies like Hadoop, Spark, and distributed computing frameworks.
    Expectation is to use Hue and run Hive SQL queries, schedule Apache Oozie jobs to automate the data workflows.
    Degree in Data Science, Statistics, Computer Science or other related fields or an equivalent combination of education and experience.

    Proficiency in at least one cloud platform (AWS, Azure, GCP) & developing ETL processes using ETL tools, big data processing and analytics with Databricks.


    • Expertise in building data pipelines in big data platforms; Good understanding of Data warehousing concepts
    Good working experience of communicating with the stakeholders and collaborate effectively with the business team for data testing.
    Expectation is to have strong problem-solving and troubleshooting skills.
    Expectation is to establish comprehensive data quality test cases, procedures and implement automated data validation processes.

    Strong communication, problem solving and analytical skills with the ability to do time management and multi-tasking with attention to detail and accuracy.

    Strong business acumen & demonstrated aptitude for analytics that incite action.


    Qualifications (Preferred):
    Good experience building Real-Time streaming data pipelines with Kafka, Kinesis etc.
    Knowledge of Jinja/YAML templating in Python is a plus.
    Knowledge and experience in designing and developing RESTful services.
    Working knowledge of DevOps methodologies, including designing CI/CD pipelines
    Experience building distributed architecture-based systems, especially handling large data volumes and real-time distribution.
    Good working experience of communicating with the stakeholders and collaborate effectively with the business team for data testing.
    Expectation is to have strong problem-solving and troubleshooting skills.
    Expectation is to establish comprehensive data quality test cases, procedures and implement automated data validation processes.
    Initiative and problem-solving skills when working independently.
    Familiarity with Big Data Design Patterns, modelling, and architecture.
    Exposure to NoSQL databases and cloud-based data transformation technologies.
    Understanding of object-oriented design principles.
    Knowledge of enterprise integration patterns.
    Experience with messaging middleware, including queues, pub-sub channels, and streaming technologies.
    Expertise in building high-performance, highly scalable, cloud-based applications.
    Experience with SQL and No-SQL databases.
  • Axalta Coating Systems, LLC

    Azure Data Engineer-2

    1 week ago

    Axalta Coating Systems, LLC Gurugram, Haryana, India

    Axalta has remained at the forefront of the coatings industry by continually investing in innovative solutions. We engineer technologies that protect customers' products - whether they are battling heat, light, corrosion, abrasion, moisture, or chemicals - and add dimension and b ...

  • Teleparty

    Data Engineer

    14 hours ago

    Teleparty Gurgaon, India

    Teleparty is hiring Data Engineers · Join Teleparty, a premium remote entertainment service leading the charge in making social TV a global cultural phenomenon bigger than the movies. With over 10 million streamers who have installed our Netflix focused browser extension - Telepa ...

  • Nutrabay

    Data Engineer

    14 hours ago

    Nutrabay Gurgaon, India

    We are seeking a skilled Data Engineer to join our team. The ideal candidate will be responsible for handling the movement of data from various sources to our data warehouses and data lakes. The candidate should have a strong understanding of data engineering concepts and experie ...

  • Expedify

    Data Engineer

    5 days ago

    Expedify Gurugram, India

    Data Engineer - Job Description · Exp - min 1 year · Salary Budget- 4-6 lpa · Overview · is looking for an intelligent and detail-oriented Data Engineer, to join our ever expanding team of data engineering and analytics. The hire will be responsible for building and optimizing ou ...

  • EXL

    Data Engineer

    1 week ago

    EXL Gurugram, India

    Role Overview: We are looking for a go-getter person who can help support: o Data strategies to meet the demands of business requirements · Technical requirements of the organizational data needs from diverse teams · Data architecture, models and go-forward data solutions for v ...

  • NAB

    Data Engineer

    14 hours ago

    NAB Gurgaon, India

    Consultant - Data Engineer role exists to ensure the delivery of the Right data to the Right customer at the Right time and at the Right Cost using the Right tools and the Right Technology on NAB's target state Marketing Platforms. · You will enable the move, flow and processing ...

  • Saarthee

    Data Engineer

    19 hours ago

    Saarthee gurugram, India

    Position Summary : · In the Data Engineer role, you will assist on data retrieval from multiple source systems, data processing and cleansing. You will be responsible for constructing automated data pipelines and updating the serving layer for analytics and insights. · Your Rol ...

  • CodeChavo

    Data Engineer

    1 week ago

    CodeChavo Gurugram, India

    Company Description · CodeChavo is an IT consulting and software development company that helps leading brands and startups with quality product engineering, digital transformation, and clean code. We specialize in helping companies outsource their digital projects and build qual ...

  • Wipro

    Data Engineer

    14 hours ago

    Wipro Gurgaon, India

    Band : B2 · Location : Offshore (Gurgaon/Bangalore) · Shift Timings - 12:00 PM to 9:30 PM · Job Summary · Job Overview: · Our team is actively seeking a motivated and talented Visualization Engineer with Data Warehousing skills who is passionate about requirement gathering and re ...

  • BayOne Solutions

    Data Engineer

    14 hours ago

    BayOne Solutions Gurgaon, India

    We need Data Engineers with Azure, Databricks, DataStage, SQL, Kafka; Scala/Java/Python/R, etc. (any combination); experience with BI tools (tableau, Cognos, ThoughtSpot) is a plus. · Long-term contract, 2-3 rounds of interviews. · Requirement: · We are looking for an Onshore Dat ...

  • Battery Smart

    Data Engineer

    1 week ago

    Battery Smart Gurugram, India

    Position: Data Engineer · Experience – 2-3 years · Education – Graduation in any relevant field - Computer Science, Statistics, Mathematics, or Engineering from Tier-1 Institute · Location – Gurugram, Haryana · Roles & responsibilities - · Collaborate closely with the data analyt ...

  • Impetus

    Data Engineer

    14 hours ago

    Impetus Gurgaon, India

    3-7 years of IT experience range is preferred. · Worked on Hadoop Ecosystem · Good hands on experience on Spark and Hive · Able to effectively use GCP managed services e.g. Dataproc, Dataflow, pub/sub, Cloud functions, Big Query, GCS - At least 4 of these Services. · Good to have ...

  • Impetus

    Data Engineer

    14 hours ago

    Impetus Gurgaon, India

    About Impetus · Impetus Technologies is a digital engineering company focused on delivering expert services and products to help enterprises achieve their transformation goals. We solve the analytics, AI, and cloud puzzle, enabling businesses to drive unmatched innovation and gro ...

  • Crescent Techservices

    Data Engineer

    1 week ago

    Crescent Techservices Gurugram, India

    Role: GCP Data Engineer · Location: Gurgaon · Experience: 3+ Years · Responsibilities: · Design, develop, and maintain scalable and efficient data pipelines on Google Cloud Platform (GCP). · Collaborate with data architects to implement data models and ensure seamless integrati ...

  • Impetus

    Data Engineer

    14 hours ago

    Impetus Gurgaon, India

    About Impetus · Impetus Technologies is a digital engineering company focused on delivering expert services and products to help enterprises achieve their transformation goals. We solve the analytics, AI, and cloud puzzle, enabling businesses to drive unmatched innovation and gro ...

  • Upnotch Consulting

    Data Engineer

    19 hours ago

    Upnotch Consulting gurugram, India

    Position Summary : · In the Data Engineer role, you will assist on data retrieval from multiple source systems, data processing and cleansing. You will be responsible for constructing automated data pipelines and updating the serving layer for analytics and insights. · Your Rol ...

  • HuQuo Consulting Pvt. Ltd.

    Data Engineer

    19 hours ago

    HuQuo Consulting Pvt. Ltd. Gurgaon/Gurugram, India

    Job Description : · Role Overview : · We are looking for a go-getter person who can define : · - Data strategies to meet the demands of business requirements · - Technical requirements of the organizational data needs from diverse teams · - Data architecture, models and go-forwar ...

  • Huquo

    Data Engineer

    19 hours ago

    Huquo gurugram, India

    Position : Snowflake DE · Location : Pune, Gurgaon · Experience : 6-9 Years · Clairvoyant is a global technology consulting and services company founded in 2012, headquartered in Chandler, US, and have delivery centers across the globe. We help organizations maximize the value of ...

  • HuQuo Consulting Pvt. Ltd.

    Data Engineer

    19 hours ago

    HuQuo Consulting Pvt. Ltd. Gurgaon/Gurugram, India permanent

    MIS team is seeking a GCP Data Engineer to create, deliver, and support custom data products, as well as enhance/expand team capabilities. They will work on analyzing and manipulating large datasets supporting the enterprise by activating data assets to support Enabling Platforms ...

  • True Tech Professionals Private Limited

    Data Engineer

    19 hours ago

    True Tech Professionals Private Limited gurugram, India

    Data Engineer - Snowflake · Location : Gurgaon (Hybrid) · Summary : · We are seeking a skilled Data Engineer with expertise in Snowflake to join our dynamic team. The ideal candidate will have a solid understanding of data governance principles and extensive experience in develop ...