Manager - BI & Data Management - Gurugram, India - Marks and Spencer Reliance India Private Limited

    Marks and Spencer Reliance India Private Limited
    Marks and Spencer Reliance India Private Limited Gurugram, India

    1 week ago

    Default job background
    Description

    Position - Data Engineer - BI & Data Management

    Experience Years

    Location - Gurgaon HO

    Key Deliverables ((Essential functions & Responsibilities of the Job):

    • Experience in building and managing ETL/Data Pipelines handling large amounts of data.
    • Data extraction, transformation, designing, coding, and tuning big data processes using Snowflake, PySpark and Spark.
    • Deep technical skills in AWS Glue (Crawler, Data Catalog, DataBrew).
    • Experience to build data platforms on AWS using core AWS services Step function, EMR, Lambda, Athena
    • Good experience in processing variety of data format (ORC, Parquet, Json, xml) using PySpark.
    • Good experience in modern data platform components such as the Hadoop, Hive, Pig, Kafka
    • Strong knowledge in query writing and query optimization