Data Engineer - Pune, India - TD Newton

    TD Newton
    TD Newton Pune, India

    2 weeks ago

    Default job background
    permanent Technology / Internet
    Description

    Job Description :

    Must have Requirements :
    To be successful in this role, you should meet the following requirements :

    • Scala development and design using Scala 2.10+ or Java development and design using Java 1.8+.
    • Experience with most of the following technologies : Apache Hadoop, Scala, Apache Spark, Spark streaming, YARN, Kafka, Hive, Python, ETL frameworks, Map Reduce, SQL, RESTful services.
    • Sound knowledge on working Unix/Linux Platform
    • Handson experience building data pipelines using Hadoop components
    • Hive, Spark, Spark SQL.
    • Experience with industry standard version control tools (Git, GitHub), automated deployment tools (Ansible & Jenkins) and requirement management in JIRA.
    • Understanding of big data modelling techniques using relational and nonrelational techniques
    • Experience on Debugging the Code issues and then publishing the highlighted differences to the development team/Architects
    )