- 3+ years in Azure Data Engineering
- Very good at ADF (Azure Data Factory)
- Hands-on experience in designing and implementing data solutions on Azure Organization : A global provider of Automation solutions in Assembly, Inspection, and Testing for manufacturing industries.
- Design and implement data solutions on Azure using ADF, Databricks, Stream Analytics / Spark
- Develop and optimize data pipelines to extract, transform, and load data from various sources into Azure data lakes
- Collaborate with data architects and business stakeholders to understand data requirements and translate them into technical solutions.
- Implement data integration and data transformation processes using ADF and Databricks.
- Perform data profiling, validation, and cleansing activities to ensure data accuracy and consistency.
- Develop and maintain data orchestration workflows and scheduling using ADF.
- Monitor and troubleshoot data pipelines to identify and resolve issues in a timely manner.
- Optimize data storage and retrieval processes for performance and cost-efficiency.
- Implement data security and privacy measures, including data encryption and access controls.
- Document technical specifications, data mappings, and data lineage for future reference.
- Bachelor's degree in Computer Science, Information Technology, or a related field.
- 3 to 5 years of hands-on experience in designing and implementing data solutions on Azure, with a focus on ADF, Databricks, Stream Analytics / Spark
- Strong proficiency in ADF, including pipeline development, data integration, and orchestration.
- Experience with Databricks for data transformation, ETL processes, and data analytics.
- Proficiency in Python scripting for data manipulation, transformation, and automation.
- Solid understanding of data modeling, data warehousing concepts, and data integration patterns.
- Experience with data profiling, data quality management, and data governance practices.
- Familiarity with Azure services like Azure Data Lake Storage, Azure SQL Database, and Azure Cosmos DB.
- Strong analytical and problem-solving skills with the ability to troubleshoot and resolve data-related issues.
- Excellent communication and collaboration skills to work effectively with cross-functional teams.)
-
Data Enginer
2 weeks ago
NatWest Group Bengaluru, Karnataka, IndiaOur people work differently depending on their jobs and needs. From hybrid working to flexible hours, we have plenty of options that help our people to thrive. · This role is based in India and as such all normal working days must be carried out in India. · Join us as a Data Engi ...
-
Data Engine
2 weeks ago
Decathlon Bengaluru, IndiaPermanent contract · - Full-time · - Mid-Senior level · - BTEC Higher National Diploma, Diploma of Higher Education · - Data engineer · **Mission**: · **Our Purpose**: · **_"Move people through the wonders of Sport"_** · **About Decathlon Sports India**: · Founded in 1976 in Fran ...
-
Data Engine
2 weeks ago
Decathlon India Bengaluru, India**Our Purpose**: *"Move people through the wonders of Sport"*About Decathlon Sports India: · Founded in 1976 in France, we have set about making the pleasure and benefit of sports available for everyone across the globe. We do that by providing world-class products both for enthu ...
-
HD Map Data Collector Dev Engineer
6 days ago
Mercedes-Benz bangalore, IndiaTätigkeitsbereich:Forschung & Entwicklung incl. DesignFachabteilung:InfotainmentGesellschaft:Mercedes-Benz Research and Development India Private LimitedStandort:Mercedes-Benz Research and Development India, BangaloreStartdatum:sofortVeröffentlichungsdatum:..4Stellennummer:MERV J ...
-
Data Engineer-2
1 week ago
Deutsche Bank Bengaluru, Karnataka, India**Data Engineer-2**: · **Job ID**:R0333521**Full/Part-Time**:Full-time**Regular/Temporary**:Regular**Listed**: **Location**:Bangalore**Position Overview**: · **Job Title - Data Engineer** · **Location - Bangalore, India** · **Role Description** · Role is an Data Engineer to manag ...
-
Data Engineer t9
2 weeks ago
Mercedes-Benz Research and Development India Private Limited Bengaluru, India**Aufgaben**: · - Education: Masters/Bachelors in Computer Science, Electrical / Electronics or Equivalent engineering · Good analytics skills · - Skill Requirements: · - Excellent Programming skills in Python. · - Experience with cloud technologies like Azure, AWS, GCP, public o ...
-
Azure Data Engineer
1 week ago
DigitalCube Consultancy Bengaluru, Karnataka, India**Azure Data Engineer** · **Job Type · - Full time** · **Location · - Bangalore/ Mumbai, India** · **Responsibilities**: · - Design, develop, and maintain scalable data pipelines using Azure Data Factory, Azure Databricks, and other Azure data services. · - Utilize Databricks for ...
-
Data Engineer-1
2 weeks ago
Commonwealth Bank Bengaluru, India**Your business**: · The Commonwealth Bank is the leading financial institution in Australia and provides integrated financial services. · The role sits within the Bankwest Technology division. Bankwest is a subsidiary of The Commonwealth Bank, and the Bankwest Technology divisio ...
-
Data Engineer-1
1 week ago
Kyndryl Bengaluru, Karnataka, IndiaWho We Are · At Kyndryl, we design, build, manage and modernize the mission-critical technology systems that the world depends on every day. So why work at Kyndryl? We are always moving forward - always pushing ourselves to go further in our efforts to build a more equitable, inc ...
-
Data Engineer 169368 Full-time
3 weeks ago
HyreFox Consultants Bengaluru, India Full timeBuild and maintain end-to-end data engineering pipelines on batch data. · - Design and implement batch data ingestion pipelines. · - Design and implement batch data transformation pipelines. · - Design and implement batch data storage solutions. · - Implement batch data governanc ...
-
Big Data Engineer 2023
1 day ago
Bosch Group Bengaluru, IndiaCompany Description · **Bosch Global Software Technologies Private Limited** is a 100% owned subsidiary of Robert Bosch GmbH, one of the world's leading global supplier of technology and services, offering end-to-end Engineering, IT and Business Solutions. With over 22,700 associ ...
-
Data Engineer-5 to 11years
3 days ago
Black & White Business Solutions Bengaluru, India**Job Information**: · Industry · **IT Services** · *** · Province · **Karnataka** · *** · City · **Bangalore North** · *** · Postal Code · **560001** · *** · Country · **India** · Job Title:Data engineer · Years Of exp:5 to 11years · Location:Hyderabad/Pune/Coimbatore · NP:Immed ...
-
Azure Data Engineer-3-10years-hyderabad
3 weeks ago
Black & White Business Solutions Bengaluru, India**Job Information**: · Industry · **IT Services** · *** · Province · **Karnataka** · *** · City · **Bangalore North** · *** · Postal Code · **560001** · *** · Country · **India** · Job Title:Azure data Bricks · Years of EXP:3 to 10Years · Location:Hyderabad · NP:30Days/Immediate ...
-
Data Engineer
4 days ago
Concentrix Bengaluru, IndiaJob Description: · Experience: 4 Years - 8 Years · Job Location: PAN India · Notice Period: Immediate/ 15 Days · Shift Timings: 03:00 PM to 12:00 AM (IST) · Skills: Data Engineering; data Pipeline; ETL, AWS (and frameworks), Pyspark/ scala; SQL & python · Job Description: · We ar ...
-
Data Engineer
6 days ago
Genpact bangalore, IndiaInviting applications for the role of Principal Consultant-Senior Data Engineer · Include optimizing data pipelines, ensuring data integrity and consistency, enhancing system resiliency where applicable, maintaining and improving data security, proactive alerting, and monitorin ...
-
Data Engineer
6 days ago
Recro bangalore, IndiaExperience:3+ years · Work location: Bangalore · primary_skills(Must_have) · Programming Skills: Proficiency in Python, Pyspark, and SQL is essential. · Big Data Experience: Hands-on experience with Spark and relational databases such as Postgres is required. · Orchestratio ...
-
Data Engineer
1 week ago
Joveo Bengaluru, IndiaWe are looking for talented Data Engineers who are passionate about data engineering and have strong experience in building scalable data pipelines. As a Data Engineer at Joveo, you will play a leading role in designing and building datasets that power analytics for teams across ...
-
Data Engineer
6 days ago
Ascendion Bengaluru, IndiaJob Title: Data Engineer/ Lead · Duration: Full Time · Location: Bengaluru, Hyderabad, Chennai, Pune (Hyrbrid) · NOTE: Looking for Immediate Joiners ( 2-3 weeks notice) · Proficient in Azure Cloud services (or GCP is Ok) for data engineering tasks. · Familiarity with Kubefl ...
-
Data Engineer
6 days ago
Novo Nordisk bangalore, IndiaJob Description: · As Data engineer, you will have the opportunity: - · Applying strong technical experience building highly reliable services on managing and orchestrating a multi-petabyte scale data lake. You will have to work in a fast-paced environment. · You are responsi ...
-
Engineer, Data
3 weeks ago
Giant Eagle GCC , Karnataka, IndiaJob Summary · As a Data Engineer on the Customer Loyalty & Experience team, you will be working on a team to bring customer-centric personalization to life. In this role, you will be empowered to develop data solutions in support of marketing analytics and data science by engagin ...
Azure Data Engineer - Bangalore, India - Talent Bee Consulting Pvt Ltd
Description
About the job :
Ideal Candidate :
Over the last 16+ years, they have been providing automation solutions that are scalable and cost-effective.
Roles And Responsibilities :
We are seeking an experienced Azure Data Engineer with 4 to 5 years of hands-on experience in Azure Data Factory (ADF), Databricks, and Python.
In this role, you will be responsible for designing, implementing, and managing data solutions on Microsoft Azure, with a specific focus on ADF, Databricks, and Python scripting.
You will collaborate with cross-functional teams to gather data requirements, develop efficient data pipelines, and ensure data quality and integrity.
Key Responsibilities :
Candidate :