Manager - BI & Data Management - Gurugram, India - Marks and Spencer Reliance India Private Limited

    Marks and Spencer Reliance India Private Limited
    Marks and Spencer Reliance India Private Limited Gurugram, India

    2 weeks ago

    Default job background
    Description
    Position - Data Engineer - BI & Data ManagementExperience YearsLocation - Gurgaon HO

    Key Deliverables ((Essential functions & Responsibilities of the Job):

    Experience in building and managing ETL/Data Pipelines handling large amounts of data.
    Data extraction, transformation, designing, coding, and tuning big data processes using Snowflake, PySpark and Spark.

    Deep technical skills in AWS Glue (Crawler, Data Catalog, DataBrew).Experience to build data platforms on AWS using core AWS services Step function, EMR, Lambda, AthenaGood experience in processing variety of data format (ORC, Parquet, Json, xml) using PySpark.

    Good experience in modern data platform components such as the Hadoop, Hive, Pig, KafkaStrong knowledge in query writing and query optimization