Azure Data Engineer - Bengaluru, India - DigitalCube Consultancy

Description

JObDescription

JobTitleAzure DataEngineer

JobTypePermanent

LocationBangalore

Responsibilities:

Design develop and maintain scalable data pipelines using AzureData Factory Azure Databricks and other Azure dataservices.

Utilize Databricks for big data analytics and realtime dataprocessing ensuring optimal performance andefficiency.

Collaborate with data architects to design and implement effectivedata models and architectures to support businessrequirements.

Implement ETL processes for data extraction transformation andloading ensuring the integrity and quality of thedata.

Integrate data from various sources ensuring compatibility accuracyand adherence to data governancestandards.

Identify and address performance bottlenecks in data pipelinesoptimizing for speed reliability andscalability.

Work closely with crossfunctional teams including data scientistsanalysts and business stakeholders to understand data requirementsand deliver effectivesolutions.

Conduct code reviews enforce best practices in coding anddocumentation and mentor junior teammembers.

Education:

Bachelors or master s degree in Computer Science Information Systems or arelatedfield.

Experience:

Minimum of 6 years of handson experience as a Data Engineer with afocus on Azure Data Engineering andDatabricks.

TechnicalSkills:

Proficiencyin Azure Data Factory Azure Databricks Pyspark SQL Python and ETLprocesses.

Solidunderstanding of data modeling data warehousing and big dataconcepts

Technical Skills: Proficiency in Azure Data Factory, AzureDatabricks, Pyspark, SQL, Python, and ETL processes. Solidunderstanding of data modeling, data warehousing, and big dataconcepts