Havells - Data Engineer/Senior Data Engineer - Spark/Hadoop - Bengaluru, India - Havells India Limited

    Havells India Limited
    Havells India Limited Bengaluru, India

    3 weeks ago

    Default job background
    Description

    Job Description :

    Must have :

    5- 10 years of meaningful experience in data engineering working on building ETL pipelines, big data tech like spark

    Very good expertise in algorithms and data structures

    Excellent in at least one programming language - Python, Go, R

    Hands-on expertise big data technologies such as Apache Spark, Hadoop, message queues(Kafka), Apache Airflow, Azure ML, Elastic Search

    Hands-on expertise working on analytics platforms such as Azure synapse or equivalent

    Good understanding of performance analysis and optimizations

    Hands-on experience in at least one cloud platform Azure(preferred), AWS, or GCP

    B.E/B.Tech/M.E/M.Tech/M.S in Computer/Electronics Engineering or equivalent degrees with experience

    Databases : Hands-on expertise in data modeling, database schema definition, query optimization, usage of relevant data stores (blob storage, data warehouse, MongoDB, TimescaleDB)

    Nice to have :

    Experience in publishing research papers or filing patents

    Knowledge of data visualization tools such as Power BI, Tableau

    Working knowledge of the Internet of Things desired

    Knowledge of internet-scale cloud-based distributed systems

    Good understanding of MQTT, WebSockets, Azure Service Bus, Apache Pulsar

    Good knowledge of Domain-Driven Design, Test Driven Development

    Experience developing in an Agile / SCRUM Environment

    Mandatory Skills : Azure, dat bricks, Data Factory,Pyspark,

    )