Azure Data Engineer - Anywhere in India/Multiple Locations - Live Connections

Live Connections Anywhere in India/Multiple Locations

1 week ago

permanent Technology / Internet

Description

Azure Data Engineer - Python/PySpark

We are seeking a skilled and experienced Azure Data Engineer with expertise in PySpark and Python coding. The ideal candidate should have a strong background in data engineering, with a focus on developing solutions using PySpark and Python within the Azure Databricks environment.

Key Responsibilities :

PySpark Development : Lead and contribute to the development of data engineering solutions using PySpark and Python within the Azure Databricks platform.

Azure Databricks Expertise : Utilize deep knowledge and experience with Azure Databricks to design, implement, and optimize data workflows and pipelines.

Coding Proficiency : Demonstrate a minimum of 3 years of hands-on experience in PySpark with Python coding, ensuring high-quality and efficient code development.

Data Integration : Work collaboratively with cross-functional teams to integrate data from various sources, ensuring data accuracy, consistency, and reliability.

Performance Optimization : Identify and implement performance optimization techniques to enhance the efficiency of data processing and analytics.

Data Transformation : Develop and maintain data transformation processes to support the extraction, transformation, and loading (ETL) of data into data lakes or warehouses.

Collaboration : Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and contribute to the design and implementation of scalable and reliable data :

1. Bachelor's degree in Computer Science, Information Technology, or a related field.

2. Minimum of 6 years of experience in data engineering, with a focus on PySpark and Python development.

3. Proven experience (at least 3 years) in PySpark with Python coding.

4. Solid understanding of Azure Databricks and its components.

5. Strong problem-solving and analytical skills.

6. Excellent communication and collaboration abilities.

7. Experience with data lakes, data warehouses, and ETL processes.

8. Familiarity with big data technologies and distributed computing.

)

Data Engineer

3 days ago

Paralleldots Anywhere in India/Multiple Locations permanent

Job Description : · As a Senior Data Engineer at ParallelDots, you will be responsible for overseeing the design and development of advanced data solutions. You will work closely with data scientists, analysts, and other stakeholders to ensure that our data infrastructure meets t ...
Data Engineer

1 week ago

Mobile Programming LLC Anywhere in India/Multiple Locations/Bangalore permanent

Job Description : · Position : Data Engineer · Experience : 6+ years · Work Mode : Work from Office · Location : Bangalore · Experience in Nifi or Tibco is mandatory. · Mandatory Skills : ETL, DevOps platform, Nifi or Tibco · Please note : This position is focused on development ...
Data Engineer

3 days ago

Forward Eye Technology Anywhere in India/Multiple Locations permanent

Job Description : · Overview : · As a Data Engineer specializing in Azure Data Platform, you will be responsible for designing, building, and maintaining data solutions on Microsoft Azure. Your expertise in data modeling, ETL/ELT processes, and tools such as Azure Data Factory (A ...
Data Engineer

5 hours ago

Huquo Anywhere in India/Multiple Locations permanent

Position : AWS Data Engineer · Location : Pune/ Gurgaon/ Hybrid · Experience : 5+ · Job Description : · - 5+ years of experience as a Data Engineer on the AWS Stack · - AWS Solutions Architect or AWS Developer Certification required · - Solid experience with AWS services such as ...
Data Engineer

3 days ago

Perfecthire Anywhere in India/Multiple Locations permanent

Job Description : · We are seeking a talented and experienced Data Engineer to join our team and play a key role in the development and implementation of our end-to-end 834 EDI solution. · A robust level of experience or familiarity with 834 EDI (Electronic Data Interchange) tr ...
Data Engineer

3 days ago

Rocket Consulting Anywhere in India/Multiple Locations/Pune permanent

A Data Engineer/developer having good experience working with · Primary skills : Python, AirFlow - ETL skills - GCP · Secondary skills : Google Cloud Composer - Google Big Query - Google Cloud · - Storage - SQL - MS SQL Serve · - Proven experience as a Data Engineer/Developer wit ...
Data Engineer

2 days ago

Change leaders Anywhere in India/Multiple Locations permanent

Primary Skill - GCP + Python + SQL · OR · GCP + Java + SQL · NP - Immediate to 35 Days max · Job Location - Mumbai / Pune / Chennai / Bangalore / Hyderabad / Kolkata / Noida · - Bachelor's degree in computer science or a related discipline · - 6+ years of applicable engineering e ...
Data Engineer

1 week ago

Ridgeant Techonologies Anywhere in India/Multiple Locations permanent

Responsibilities : · - Collaborate with stakeholders to understand business requirements and data needs, and translate them into scalable and efficient data engineering solutions using AWS Data Services. · - Design, develop, and maintain data pipelines using AWS serverless techno ...
Data Engineer

1 week ago

Lancesoft India Pvt Ltd Anywhere in India/Multiple Locations permanent

Hiring for an experienced data engineer to join our team. You will use various methods to transform raw data into useful data systems. For example, you'll create algorithms and conduct statistical analysis. Overall, you'll strive for efficiency by aligning data systems with busin ...
Data Engineer

3 days ago

Aricent Anywhere in India/Multiple Locations permanent

Job Profile : Data Engineer · Location : WFO/WFH (Both Available) · Specialization : IT/Cloud/Data Management · Job Description : · - Completed Bachelors degree or diploma (or equivalent experience) in Computer Science, Software Engineering or Software Architecture preferred; ca ...
Data Engineer

1 week ago

AAR Consultancy Anywhere in India/Multiple Locations permanent

Technical Skills : · 1. Google Cloud Platform (GCP) : In-depth knowledge and hands-on experience with GCP services such as BigQuery, Dataflow, Dataproc, Pub/Sub, Data Studio, and Cloud Storage. · 2. Data Engineering : Strong understanding of data engineering principles, including ...
Data Engineer

1 week ago

Arting Digital Anywhere in India/Multiple Locations permanent

Position Title : Data Engineer · Exp : 5+ years · Location : Remote · Primary Skills : Data warehousing, ETL leveraging Snowflake, ADF ,Python · Qualification : Any · Roles and responsibilities : · - An offshore Data Engineer to work with the Investment Analytics team. · - This ...
Data Engineer

2 days ago

Teksands Anywhere in India/Multiple Locations permanent

The Data engineer is responsible for development & maintenance of the Data Lake within the Advice & Wealth Management technology team. You should be able to collaborate with technology cross-commits and business teams to code, test and deploy scalable solution and adhering to req ...
Data Engineer

3 days ago

Mobile Programming Anywhere in India/Multiple Locations/Bangalore permanent

Job Summary: · We are looking for an experienced data engineer to join our team. You will use various methods to transform raw data into useful data systems. For example, you'll create algorithms and conduct statistical analysis. Overall, you'll strive for efficiency by aligning ...
Data Engineer

52 minutes ago

SKEP IT SYSTEMS Anywhere in India/Multiple Locations permanent

Job Description : · We are seeking a skilled Python + SQL with DBT Developer to join our growing team. As a Python + SQL with DBT Engineer, you will be responsible for designing, developing, and maintaining data models and transformations using DBT to create analysis-ready datase ...
Data Engineer

1 week ago

Liveconnections Anywhere in India/Multiple Locations permanent

Skillset: · Data Engineering with strong SQL expertise. · Should be good in Talend, Snowflake. More preference to certified (in Talend/ Snowflake) resources. · - Should be experienced in implementing DWH projects. · - Having Informatica experience will be value-add. · Relevant Ex ...
Data Engineer

3 days ago

Forward eye technologies Anywhere in India/Multiple Locations permanent

Role : Data Engineer · Location : Remote · Shift timings : IST · Contract Period : 3 months · Experience : 5 - 8 years · Responsibilities : · - Review and understand business requirements ensuring that development tasks are completed within the timeline provided and that issues a ...
Data Engineer

1 week ago

consultancy Anywhere in India/Multiple Locations permanent

Note : It's a work-from-home opportunity. · Skills You must have experience with: · - Twilio Segment - Customer Data Platform · - Google Analytics (Inc. Firebase) · - Experience creating tailored dashboards using PowerBi · - Experience in data management, data warehousing, data q ...
Data Engineer

2 days ago

VAYUZ Technologies Anywhere in India/Multiple Locations permanent

Responsibilities : · - Use Azure Data Factory (ADF) to create and manage data pipelines. · - Work with teams to understand what data they need and how to get it. · - Make sure our data is stored and processed efficiently. · - Write SQL queries to manipulate and analyze data.- · - ...
Data Engineer

1 week ago

TechFabric Anywhere in India/Multiple Locations permanent

Job Description : · Candidate should have minimum 7Yrs working/hands-on experience in the below skills : · - With proficiency in Azure services , ADF, Data bricks, Synapse Analytics and Azure Storage · - Hands on experience in data modelling, batch and real time pipelines using ...