Azure Data Engineer - Bengaluru, Karnataka, India - DigitalCube Consultancy

DigitalCube Consultancy

Verified Company

Bengaluru, Karnataka, India

3 weeks ago

Posted by:

Deepika Kaur

beBee Recuiter

Azure Data Engineer
**Job Type

Bangalore/ Mumbai, India**
Responsibilities:
Design, develop, and maintain scalable data pipelines using Azure Data Factory, Azure Databricks, and other Azure data services.
Utilize Databricks for big data analytics and realtime data processing, ensuring optimal performance and efficiency.
Collaborate with data architects to design and implement effective data models and architectures to support business requirements.
Implement ETL processes for data extraction, transformation, and loading, ensuring the integrity and quality of the data.
Integrate data from various sources, ensuring compatibility, accuracy, and adherence to data governance standards.
Identify and address performance bottlenecks in data pipelines, optimizing for speed, reliability, and scalability.
Work closely with crossfunctional teams, including data scientists, analysts, and business stakeholders, to understand data requirements and deliver effective solutions.
Conduct code reviews, enforce best practices in coding and documentation, and mentor junior team members.

Education:

Bachelor's or master's degree in Computer Science, Information Systems, or a related field.

Experience:

Minimum of [6] years of handson experience as a Data Engineer, with a focus on Azure Data Engineering and Databricks.

Technical Skills:

Proficiency in Azure Data Factory, Azure Databricks, Pyspark, SQL, Python, and ETL processes.
Solid understanding of data modeling, data warehousing, and big data concepts

Job Types:
Full-time, Permanent

Salary:
₹2,500, ₹2,800,000.00 per year

Schedule: