Lead - Data Engineer - Gurugram, India - IIFL Home Loans

Description

Ready to unleash your data magic in the Azure cloud? We're on the hunt for a Data Engineer with a knack for Azure Data Factory, ETL wizardry, and a passion for creating data pipelines that sing As part of our dynamic data team, you'll play a crucial role in design, development, maintenance of our data infrastructure. You'll extract, transform, and load data from all corners of the digital universe into our state-of-the-art data warehouse. If you're a data sorcerer with Azure skills to match, we'd love to have you aboard

Key Responsibilities:

• Lead the design and architecture of Data Warehouse on Azure Cloud leveraging Databricks for optimal performance.
• Develop and optimize complex SQL queries for data retrieval and reporting.
• Maintain data models (physical, logical), including dimensional modelling, to support analytics requirements.
• Perform performance tuning of SQL queries and data warehouse processes.
• Implement data security measures and ensure compliance with regulatory requirements.
• Set up and manage backup and recovery procedures.
• Optimize SQL queries for analytical workloads and resource utilization.
• Enforce data governance policies within the data warehouse.
• Maintain comprehensive documentation of data warehouse design and SQL scripts.

Key Qualifications:

• Atleast 4 years of experience with data warehousing and data modeling in Azure or AWS using Databricks
• Atleast 5 years of experience working with Spark - Pyspark or SparkSQL
• Atleast 3 years of experience working with Databricks ( Databricks certification is preferred)
• Atleast 2 years of experience working with Azure Azure Data Factory