No more applications are being accepted for this job
- Create build from Github and release pipeline and Databricks using Azure Devops / Harness
- Monitor Performance of BTL Jobs, resolve any issues and improve the performance metrics as needed.
- Diagnose system performance issue related to data processing and implement solution to address
- Collaborate with other teams to ensure successful integration of data pipelines into larger system architecture requirement.
- Maintain integrity and quality across all pipelines and environments.
- Understand and follow secure coding practice to make sure code is not vulnerable
- Should have Strong background in Software development with experience in ingest, transform and store data from large datasets using SQL with strong knowledge on distributed computing concepts.
- Must have hands on experience in designing and developing Data Transformation Logic using SQL
- Must have hands on Experience with Databricks.
- Must have minimum 5 years of exposure and good proficiency in data warehousing concepts.
- Extensive experience writing, optimizing, and data pipelines.
- Proficient in SQl and database Design concepts.
- Knowledge of Azure cloud computing platform with Azure Synapse, ADLS.
- Knowledge on GitHub and build management.
- Passion for data and experience working within a data driven organization
- Excellent presentation, communication (oral & written), and relationship building skills, across all levels of management)
Semantic Modelling Data Engineer - Gurgaon/Gurugram, India - Codersbrain technology pvt ltd
Description
Job Description :
Design, Develop and maintain Business Translation Layer pipelines using SQL/DBT in Azure Databricks
Skills: