No more applications are being accepted for this job
- Solid experience in Azure, specifically Azure Databricks and Azure SQL/SQL Server.
- Proficiency in SQL and Python languages.
- Handson experience in designing and building data pipelines using Azure Data Factory (ADF).
- Familiarity with building metadata driven pipelines.
- Knowledge of Azure Storage, Medallion Architecture, and working with data formats such as JSON, CSV, and Parquet.
- Strong understanding of IT concepts, including security, IAM, Key Vault, and networking.
- Exposure to Apache Airflow and DBT is a bonus.
- Familiarity with agile principles and practices.
- Experience with Azure DevOps pipelines.
- Certification in Azure or related technologies.
- Experience with other cloud platforms (e.g., AWS, Google Cloud).
- Knowledge of big data technologies
- Familiarity with data governance and compliance frameworks.
- Develop and maintain data pipelines using Azure Data Factory (ADF), ensuring efficient and reliable data movement and transformation.
- Data Modelling using Kimball, 3NF or Dimensional methodologies
- Utilize SQL and Python languages to extract, transform, and load data from various sources into Azure Databricks and Azure SQL/SQL Server.
- Design and implement metadata driven pipelines to automate data processing tasks.
- Ensure data quality, integrity, and security throughout the data pipeline.
- Troubleshoot and resolve any issues or errors in the data pipelines.
- Stay updated with the latest Azure technologies and industry best practices to continuously enhance data engineering capabilities.
- Driven by delivering quality work, with a great eye for detail
- Takes accountability and ownership of tasks, and finds the best way to solve problems
- Excellent communicator who can make sense of and communicate complex ideas to audiences of differing levels of seniority and technical ability
- Ability to quickly understand client context and demonstrate expertise in their business
- Relationship builder, with the ability to motivate and engage effectively to build trust with clients and colleagues.
- An interest in industry trends, emerging technologies, and client's businesses
- Ability to take the lead and drive initiatives independently
Senior Engineer - Anywhere in India/Multiple Locations - Orbiz
Orbiz
Anywhere in India/Multiple Locations
2 weeks ago
Description
Required Skills and Experience :
Nice to Have:
Key outputs for the role :
Required Characteristics :