- You are respectful and act with the highest integrity. If you see something that isn't right, you say something.
- You ask questions to understand a perspective and are comfortable respectfully challenging assumptions. You are not turned off by constructive conflict to get to the right answer.
- You set clear ambitious goals. You anticipate obstacles, persevere, and are accountable for your commitments.
- You aren't afraid to challenge the status quo and know that there's no such thing as failure if you learn from it.
- You seek out feedback and never settle in your quest to grow and develop. By being here, you make our company stronger.
- You deeply understand and respect our users and put them at the center of everything you do.
Data Engineer - New Delhi, India - Incubit
Description
About Incubit, and the difference we make.
Here at Incubit, we believe in doing work that makes an impact on the World. We are an enterprise solutions company, providing integrated technology consulting, services, products and outsourcing to our clients across the globe. With an incredibly talented and diverse team who love working with us, we combine our unparalleled problem-solving abilities with extensive experience across core business functions to create unmatched value at all business levels.
We collaborate with clients to help them become high-performance businesses by elevating experiences across their business spectrum. Our passion resonates in the work that we do, so if you are all in. So are we. Website:
Job Title: Azure Data Engineer: 4-6 years of experience
Location: New Delhi
Work Model: Work from Office
Notice Period : Immediate / Notice Serving (within 30 days)
We are seeking an experienced Azure Data Engineer with a strong background in ADLS, Delta Lake, Databricks,Azure Data Factory (ADF) and Azure Synapse Analytics to join our dynamic team. As an Azure Data Engineer, he/she will be responsible for designing, developing, and implementing data integration and data warehousing solutions on the Azure platform.
Responsibilities:
1.Design, develop, and implement end-to-end data integration solutions using Azure Data Factory (ADF) and Azure Synapse Analytics.
2.Should be well versed with Delta lakes, Delta tables, Delta Lake Architecture.
3.Collaborate with cross-functional teams to understand data requirements, design data models, and develop data pipelines for efficient data processing and analysis.
4. Develop ETL/ELT workflows, data ingestion processes, and data transformation activities using ADF pipelines and activities.
5. Optimize data processing and storage in Azure Synapse Analytics, ensuring high performance and scalability.
6. Perform data quality checks, data validation, and data profiling to ensure data accuracy and integrity.
7. Implement data security and access controls to protect sensitive data in compliance with organizational and industry standards.
8. Monitor and troubleshoot data integration and data warehousing solutions, identifying and resolving performance issues and bottlenecks.
9. Collaborate with data architects and data scientists to design and implement data lakes, data marts, and data warehouses to support analytics and reporting requirements.
10. Stay updated with the latest Azure Data Engineering trends, best practices, and technologies, and provide recommendations for process improvements and tool enhancements.
11. Document technical specifications, data flows, and solution designs to ensure effective knowledge transfer and maintainable solutions.
12. Provide technical guidance and mentorship to junior team members, sharing your expertise in Azure Data Factory, ADLS, Databricks and Azure Synapse Analytics.
Qualifications:
1. Bachelor's degree in Computer Science, Engineering, or a related field.
2. Proven experience as a Data Engineer, preferably with a focus on ADLS, Delta Lake, Databricks,Azure Data Factory and Azure Synapse Analytics.
3. Strong understanding of data integration concepts, ETL/ELT processes, and data warehousing principles.
4. In-depth knowledge of Azure Data Factory and its various components, including pipelines, activities, data flows, and triggers.
5. Hands-on experience with Azure Synapse Analytics, including data ingestion, data transformation, and data loading techniques.
6. Proficient in SQL and scripting languages (e.g., PowerShell, Python) for data manipulation and automation tasks.
7. Familiarity with data modeling, dimensional modeling, and schema design for data warehousing.
8. Solid understanding of cloud computing concepts and experience working in a cloud environment (preferably Azure).
9. Experience with Azure Data Lake Storage, Azure SQL Database, and other Azure data-related services.
10. Strong problem-solving skills and the ability to analyze complex data requirements and translate them into practical solutions.
11. Excellent communication and interpersonal skills, with the ability to collaborate effectively with cross-functional teams.
12. Azure certifications related to data engineering (e.g., Azure Data Engineer Associate) will be a plus.
Values we would love you to have:
At Incubit, we deeply believe that your career is about what you want to be and who you want to be. It's about bringing your skills, your passion and your best true self to your work. We invite you to go for it, take the leap of faith, and apply for this job if it sparks your curiosity. Join Incubit and make an Impact