Engineer_Java Spark_Neustar - Hyderabad / Secunderabad, Telangana - confidential

    confidential
    confidential Hyderabad / Secunderabad, Telangana

    6 days ago

    Full time
    Description

    Job Summary:

    We are seeking a skilled Java Spark Engineer to join our Data & Analytics team. The ideal candidate will work on building next-generation data products on Hadoop and Spark platforms, handling large-scale datasets, and collaborating with cross-functional teams to deliver high-quality data solutions.

    Roles & Responsibilities:

    Data Processing & Transformation:

    • Prototype and implement data transformations and entity resolutions on petabyte-scale data using Hadoop and Spark clusters.
    • Debug and optimize Spark code for performance improvements.

    Machine Learning Support:

    • Understand, code, and debug ML models in Spark for analytics and data processing workflows.

    Data Quality & Analytics:

    • Analyze data errors and identify root causes to improve overall data quality.
    • Work with relational, NoSQL, and graph databases to extract, transform, and query data efficiently.

    Collaboration & Communication:

    • Collaborate closely with teams generating and consuming data to ensure accurate and reliable data outputs.
    • Communicate findings and solutions clearly, both in writing and orally, to stakeholders and team members.
Jobs