Azure Data Engineer - Anywhere in India/Multiple Locations - Innover Digital Inc.

Innover Digital Inc. Anywhere in India/Multiple Locations

1 week ago

permanent Technology / Internet

Description

Job Description :

We are actively seeking a highly skilled Senior Cloud data engineer + Databricks with expertise in other databases like Oracle, significant experience in data warehousing implementation projects, and proficiency in leveraging Azure services along with databricks/ADLS Gen2 for efficient ETL design thinking and :

Design, develop, and implement complex ETL processes using Databricks to ensure streamlined and efficient data extraction, transformation, and loading in azure databricks/ADLS Gen2.
Monitor and analyze data integration job performance with Databricks /ADLS Gen2 , identifying and resolving bottlenecks for optimal system efficiency.
Implement best practices to ensure highperformance data warehousing solutions.
Apply innovative and efficient ETL design thinking principles within Azure databricks/ADLS Gen2 to create scalable and maintainable solutions.
Utilize best practices for modular and reusable ETL components, ensuring flexibility in adapting to evolving business needs.
Implement strategies to handle incremental data updates and ensure synchronization between source and target systems.
Design, implement, and manage data lake solutions on Azure Data Lake Storage.
Experience working with Delta tables, Unity Catalog
Define storage structures and access policies for raw, processed, and curated data.
Implement checkpoints and errorhandling mechanisms to minimize downtime and data loss in case of job interruptions.
Perform database tuning, query optimization, and ensure data integrity within Azure environments.
Work closely with DevOps teams to ensure the smooth deployment and operation of data solutions.
Collaborate on infrastructure as code (IaC) and version control.

Technical and Required Skills :

Bachelor's degree in Computer Science/Information Systems/ a related field (or equivalent experience).
Strong 7+ years of experience in data engineering, including designing and implementing data pipelines, ETL processes, and data integration solutions .
Proficiency in Azure services like Azure databricks/ADLS Gen2, Azure function and Oracle services like Oracle EBS.
Experience with Large data set pipe lines by using the parallel processing .
Experience with data batch processing.
Experience with SCD1 and SCD2 implemention.
Experience with Delta and Full loads.
Experience with SQL and NoSQL databases, data warehousing concepts, and big data technologies.
Proficiency in programming languages such as SQL/PL SQL and JAVA.
Familiarity with data governance, data security, and compliance practices.
Strong problemsolving and troubleshooting skills.
Excellent communication and collaboration abilities.
Ability to work effectively in a fastpaced and dynamic environment.
Familiarity in on premise Talend (Any ETL tool) services with Azure infrastructure.

Preferred Skills (not a must but value-added) :

Experience with Azure services.
Familiarity with DevOps practices and tools for continuous integration and deployment of data solutions

)

Data Engineer

2 days ago

Forward Eye Technology Anywhere in India/Multiple Locations permanent

Job Description : · Overview : · As a Data Engineer specializing in Azure Data Platform, you will be responsible for designing, building, and maintaining data solutions on Microsoft Azure. Your expertise in data modeling, ETL/ELT processes, and tools such as Azure Data Factory (A ...
Data Engineer

3 days ago

Paralleldots Anywhere in India/Multiple Locations permanent

Job Description : · As a Senior Data Engineer at ParallelDots, you will be responsible for overseeing the design and development of advanced data solutions. You will work closely with data scientists, analysts, and other stakeholders to ensure that our data infrastructure meets t ...
Data Engineer

1 week ago

Mobile Programming LLC Anywhere in India/Multiple Locations/Bangalore permanent

Job Description : · Position : Data Engineer · Experience : 6+ years · Work Mode : Work from Office · Location : Bangalore · Experience in Nifi or Tibco is mandatory. · Mandatory Skills : ETL, DevOps platform, Nifi or Tibco · Please note : This position is focused on development ...
Data Engineer

2 days ago

Perfecthire Anywhere in India/Multiple Locations permanent

Job Description : · We are seeking a talented and experienced Data Engineer to join our team and play a key role in the development and implementation of our end-to-end 834 EDI solution. · A robust level of experience or familiarity with 834 EDI (Electronic Data Interchange) tr ...
Data Engineer

1 week ago

AAR Consultancy Anywhere in India/Multiple Locations permanent

Technical Skills : · 1. Google Cloud Platform (GCP) : In-depth knowledge and hands-on experience with GCP services such as BigQuery, Dataflow, Dataproc, Pub/Sub, Data Studio, and Cloud Storage. · 2. Data Engineering : Strong understanding of data engineering principles, including ...
Data Engineer

3 days ago

Aricent Anywhere in India/Multiple Locations permanent

Job Profile : Data Engineer · Location : WFO/WFH (Both Available) · Specialization : IT/Cloud/Data Management · Job Description : · - Completed Bachelors degree or diploma (or equivalent experience) in Computer Science, Software Engineering or Software Architecture preferred; ca ...
Data Engineer

3 days ago

Rocket Consulting Anywhere in India/Multiple Locations/Pune permanent

A Data Engineer/developer having good experience working with · Primary skills : Python, AirFlow - ETL skills - GCP · Secondary skills : Google Cloud Composer - Google Big Query - Google Cloud · - Storage - SQL - MS SQL Serve · - Proven experience as a Data Engineer/Developer wit ...
Data Engineer

2 days ago

Change leaders Anywhere in India/Multiple Locations permanent

Primary Skill - GCP + Python + SQL · OR · GCP + Java + SQL · NP - Immediate to 35 Days max · Job Location - Mumbai / Pune / Chennai / Bangalore / Hyderabad / Kolkata / Noida · - Bachelor's degree in computer science or a related discipline · - 6+ years of applicable engineering e ...
Data Engineer

1 week ago

Ridgeant Techonologies Anywhere in India/Multiple Locations permanent

Responsibilities : · - Collaborate with stakeholders to understand business requirements and data needs, and translate them into scalable and efficient data engineering solutions using AWS Data Services. · - Design, develop, and maintain data pipelines using AWS serverless techno ...
Data Engineer

1 week ago

Lancesoft India Pvt Ltd Anywhere in India/Multiple Locations permanent

Hiring for an experienced data engineer to join our team. You will use various methods to transform raw data into useful data systems. For example, you'll create algorithms and conduct statistical analysis. Overall, you'll strive for efficiency by aligning data systems with busin ...
Data Engineer

1 week ago

Arting Digital Anywhere in India/Multiple Locations permanent

Position Title : Data Engineer · Exp : 5+ years · Location : Remote · Primary Skills : Data warehousing, ETL leveraging Snowflake, ADF ,Python · Qualification : Any · Roles and responsibilities : · - An offshore Data Engineer to work with the Investment Analytics team. · - This ...
Data Engineer

3 days ago

Mobile Programming Anywhere in India/Multiple Locations/Bangalore permanent

Job Summary: · We are looking for an experienced data engineer to join our team. You will use various methods to transform raw data into useful data systems. For example, you'll create algorithms and conduct statistical analysis. Overall, you'll strive for efficiency by aligning ...
Data Engineer

1 week ago

Liveconnections Anywhere in India/Multiple Locations permanent

Skillset: · Data Engineering with strong SQL expertise. · Should be good in Talend, Snowflake. More preference to certified (in Talend/ Snowflake) resources. · - Should be experienced in implementing DWH projects. · - Having Informatica experience will be value-add. · Relevant Ex ...
Data Engineer

4 hours ago

Huquo Anywhere in India/Multiple Locations permanent

Position : AWS Data Engineer · Location : Pune/ Gurgaon/ Hybrid · Experience : 5+ · Job Description : · - 5+ years of experience as a Data Engineer on the AWS Stack · - AWS Solutions Architect or AWS Developer Certification required · - Solid experience with AWS services such as ...
Data Engineer

3 days ago

Forward eye technologies Anywhere in India/Multiple Locations permanent

Role : Data Engineer · Location : Remote · Shift timings : IST · Contract Period : 3 months · Experience : 5 - 8 years · Responsibilities : · - Review and understand business requirements ensuring that development tasks are completed within the timeline provided and that issues a ...
Data Engineer

2 days ago

Teksands Anywhere in India/Multiple Locations permanent

The Data engineer is responsible for development & maintenance of the Data Lake within the Advice & Wealth Management technology team. You should be able to collaborate with technology cross-commits and business teams to code, test and deploy scalable solution and adhering to req ...
Data Engineer

1 week ago

consultancy Anywhere in India/Multiple Locations permanent

Note : It's a work-from-home opportunity. · Skills You must have experience with: · - Twilio Segment - Customer Data Platform · - Google Analytics (Inc. Firebase) · - Experience creating tailored dashboards using PowerBi · - Experience in data management, data warehousing, data q ...
Data Engineer

2 days ago

VAYUZ Technologies Anywhere in India/Multiple Locations permanent

Responsibilities : · - Use Azure Data Factory (ADF) to create and manage data pipelines. · - Work with teams to understand what data they need and how to get it. · - Make sure our data is stored and processed efficiently. · - Write SQL queries to manipulate and analyze data.- · - ...
Data Engineer

1 week ago

TechFabric Anywhere in India/Multiple Locations permanent

Job Description : · Candidate should have minimum 7Yrs working/hands-on experience in the below skills : · - With proficiency in Azure services , ADF, Data bricks, Synapse Analytics and Azure Storage · - Hands on experience in data modelling, batch and real time pipelines using ...
Azure Data Engineer

23 hours ago

DEVENIR SOFTWARE PRIVATE LIMITED Anywhere in India/Multiple Locations permanent

Position : Azure Data Engineer · Experience : 4 to 12+ years · Relevant 5+ Exp is must · Location : Pan India · Fulltime role · Immediate : · - Design, build, and maintain data pipelines and ETL processes on Azure cloud platform · - Develop and implement data solutions using Azu ...