Senior Engineer - Anywhere in India/Multiple Locations - Orbiz

    Orbiz
    Orbiz Anywhere in India/Multiple Locations

    2 weeks ago

    Default job background
    permanent Technology / Internet
    Description

    Required Skills and Experience :

    • Solid experience in Azure, specifically Azure Databricks and Azure SQL/SQL Server.
    • Proficiency in SQL and Python languages.
    • Handson experience in designing and building data pipelines using Azure Data Factory (ADF).
    • Familiarity with building metadata driven pipelines.
    • Knowledge of Azure Storage, Medallion Architecture, and working with data formats such as JSON, CSV, and Parquet.
    • Strong understanding of IT concepts, including security, IAM, Key Vault, and networking.
    • Exposure to Apache Airflow and DBT is a bonus.
    • Familiarity with agile principles and practices.
    • Experience with Azure DevOps pipelines.

    Nice to Have:

    • Certification in Azure or related technologies.
    • Experience with other cloud platforms (e.g., AWS, Google Cloud).
    • Knowledge of big data technologies
    • Familiarity with data governance and compliance frameworks.

    Key outputs for the role :

    • Develop and maintain data pipelines using Azure Data Factory (ADF), ensuring efficient and reliable data movement and transformation.
    • Data Modelling using Kimball, 3NF or Dimensional methodologies
    • Utilize SQL and Python languages to extract, transform, and load data from various sources into Azure Databricks and Azure SQL/SQL Server.
    • Design and implement metadata driven pipelines to automate data processing tasks.
    Collaborate with cross-functional teams to understand data requirements and implement appropriate solutions.

    • Ensure data quality, integrity, and security throughout the data pipeline.
    • Troubleshoot and resolve any issues or errors in the data pipelines.
    • Stay updated with the latest Azure technologies and industry best practices to continuously enhance data engineering capabilities.

    Required Characteristics :

    • Driven by delivering quality work, with a great eye for detail
    • Takes accountability and ownership of tasks, and finds the best way to solve problems
    • Excellent communicator who can make sense of and communicate complex ideas to audiences of differing levels of seniority and technical ability
    • Ability to quickly understand client context and demonstrate expertise in their business
    • Relationship builder, with the ability to motivate and engage effectively to build trust with clients and colleagues.
    • An interest in industry trends, emerging technologies, and client's businesses
    • Ability to take the lead and drive initiatives independently
    )