- 5+ years of experience with cloud data engineering (preferably Azure), data pipelines and Spark. Candidate should have knowledge in coding part/
- Work with Databricks platform using Spark for big data processing and analytics.
- Write optimized and efficient code using PySpark, SparkSQL and Python.
- Develop and maintain ETL processes using Databricks notebooks and workflows.
- Implement and optimize data pipelines for data transformation and integration.
- Knowledge of one or more SQL variant, preferably PL/SQL and Spark SQL.
- Write complex SQL queries for data retrieval, manipulation, and analysis.
- Debugging code when required and troubleshooting any Python, Pyspark or SQL related queries.
- Good Experience with version control (Git) and ci/cd(Good to have)
- Excellent problem-solving ability with solid communication and collaboration skills.
Databricks Engineer - Hyderabad / Secunderabad, Telangana, Pune, Bengaluru / Bangalore - confidential
Description
Role: Databricks Engineer
Exp: 7 Years to 10 years
Location: PAN India
Job description: