Azure Data Bricks - Bengaluru, Karnataka, India - ITC Infotech India Ltd

ITC Infotech India Ltd

Verified Company

Bengaluru, Karnataka, India

1 week ago

Posted by:

Deepika Kaur

beBee Recuiter

Description

NSR-6319: ITC Infotech - Databricks/PySpark offshore Developer:
Offshore Lead Databricks/PySpark Developer

Minimum Qualifications and Job Requirements:

Must be a team player.
Must have following

SCALA, SQL, Spark/Spark Streaming, Big Data Tool Set, Linux, Python/PySpark Kafka

Experience collaborating with dev team, project managers, and engineers.
Excellent communication and teamwork skills

Essential Job Functions:

Design and development of data ingestion pipelines (Databricks background preferred).
Performance tune and optimize the databricks jobs
Evaluated new features and refractors existing code
Mentor junior developers and makes sure all patterns are documented
Perform data migration and conversion activities.
Perform end to end automation of ETL process for various datasets that are being ingested into the big data platform.
Ensures to understand the requirements thoroughly and in detail and identify gaps in requirements
Ensures that detailed unit testing is done, handles negative scenarios and document the same
Work with QA and automation team.
Works on best practices and documenting the process

- code merges and releases (Bitbucket)