Azure Data engineer - Bengaluru, India - Birlasoft

Description

Azure Data Engineer with Databricks and PySpark

Job Title: Azure Databricks Lead

Location: [Bangalore/Hyderabad/Chennai/Pune/Noida]

Company Description: [Birlasoft]

Job Description:

We are seeking a highly skilled Azure Databricks Lead to join our dynamic team. As an Azure Databricks Lead, you will be responsible for leading and managing the implementation of Azure Databricks solutions for our clients. You will collaborate with various stakeholders to understand business requirements, architect scalable solutions, and oversee the development and deployment processes. The ideal candidate will possess strong technical expertise in Azure Databricks, along with excellent leadership and communication skills.

Responsibilities:

1. Lead the design, development, and implementation of Azure Databricks solutions.
2. Collaborate with business stakeholders to understand requirements and translate them into technical specifications.
3. Architect scalable and efficient data pipelines using Azure Databricks.
4. Provide technical guidance and mentorship to team members.
5. Perform code reviews and ensure adherence to best practices and coding standards.
6. Troubleshoot and resolve technical issues related to Azure Databricks implementations.
7. Manage project timelines, budgets, and resources effectively.
8. Stay updated on the latest trends and advancements in Azure Databricks and related technologies.
9. Drive continuous improvement initiatives to enhance the performance and reliability of Azure Databricks solutions.
10. Work closely with cross-functional teams to ensure successful project delivery.

Qualifications:

1. Bachelor's or Master's degree in Computer Science, Engineering, or a related field.
2. Proven experience in leading Azure Databricks projects from inception to completion.
3. Strong proficiency in Apache Spark and Python programming.
4. In-depth knowledge of Azure cloud services, including Azure Databricks, Azure Data Lake Storage, Azure SQL Database, etc.
5. Experience with data engineering concepts and techniques, including ETL, data modeling, and data warehousing.
6. Excellent analytical and problem-solving skills.
7. Ability to communicate effectively with technical and non-technical stakeholders.
8. Strong leadership skills with the ability to motivate and mentor team members.
9. Experience with DevOps practices and tools is a plus.
10. Azure certifications such as DP-203: Data Engineering on Microsoft Azure or DP-200: Implementing an Azure Data Solution would be advantageous.