DataBricks Engineer - Bengaluru, India - Magna

Description

About usWe see a future where everyone can live and move without limitations.

That's why we are developing technologies, systems and concepts that make vehicles safer and cleaner, while serving our communities, the planet and, above all, people.

Forward. For all.
Group SummaryMagna is more than one of the world's largest suppliers in the automotive space. We are a mobility technology company built to innovate, with a global, entrepreneurial-minded team.

With 65+ years of expertise, our ecosystem of interconnected products combined with our complete vehicle expertise uniquely positions us to advance mobility in an expanded transportation landscape.

About the Role

This position will be engaged in design and deploy of large-scale data processing frameworks and pipelines on Databricks to support enterprise-wide BI and data science initiatives.

It will also provide user training and data coaching for effective Databricks usage.

Your Responsibilities

Create MLOps frameworks for model development, training, deployment, and monitoring.
Optimize Databricks clusters for performance, scalability, and resource efficiency.
Monitor cluster health, performance metrics, and resource usage, adjusting cluster sizes as needed.
Design efficient data processing systems and pipelines using Databricks, APIs, and other cloud services.
Act as the Databricks expert and uphold platform standards.
Collaborate with Data and Platform architects on defining the product roadmap.

Who we are looking for

Bachelor's degree in Computer Science or related field.7+ years of IT experience, including 5+ years in Databricks development and administration, Spark, and cloud platforms (preferably Azure).Proficiency in Databricks admin and development, with expertise in Resource and Performance Management.

Expertise in test automation, continuous integration, Docker, GitHub, Jenkins, and Unix/Linux.
Leadership in large project initiatives, willingness to mentor, and support for team members from different time zones.

Your preferred qualifications

Experience with Kafka and Spark, and strong in Python and Pyspark.
Hands-on experience in machine learning pipelines and scripting languages.
Familiarity with Java, Python, SQL/NoSQL databases, and Big Data tools.
Passion for new tech, continuous improvement, and collaborative problem-solving.
Proactive, strong work ethic, and team player.

What we offer

At Magna, you can expect an engaging and dynamic environment where you can help to develop industry-leading automotive technologies. We invest in our employees, providing them with the support and resources they need to succeed.

As a member of our global team, you can expect exciting, varied responsibilities as well as a wide range of development prospects.

Because we believe that your career path should be as unique as you are.

Site Benefits

Exact site benefits will be provided together with the offer.

Awareness. Unity. Empowerment.

At Magna, we believe that a diverse workforce is critical to our success. That's why we are proud to be an equal opportunity employer.

We hire on the basis of experience and qualifications, and in consideration of job requirements, regardless of, in particular, color, ancestry, religion, gender, origin, sexual orientation, age, citizenship, marital status, disability or gender identity.

Magna takes the privacy of your personal information seriously. We discourage you from sending applications via email to comply with GDPR requirements and your local Data Privacy Law.