- Design, develop, and maintain scalable data pipelines and ETL processes using Databricks and PySpark.
- Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and implement data solutions that align with business needs.
- Optimize and tune existing data pipelines for performance and reliability.
- Work closely with cloud-based services, particularly Azure or AWS, to deploy and manage data solutions in the cloud environment.
- Implement data quality and data governance best practices to ensure the accuracy and reliability of the data.
- Monitor and troubleshoot data pipelines, resolving issues promptly to minimize downtime and data loss.
- Stay updated with the latest industry trends and technologies related to data engineering, Databricks, PySpark, and cloud platforms.
- Collaborate with cross-functional teams to integrate data engineering solutions into various applications and systems.
- Document data engineering processes, architectures, and configurations for reference and knowledge sharing.
- Provide technical guidance and mentorship to junior data engineers in the team.
- Design, develop, and maintain scalable data pipelines using Azure Data Factory, Azure Databricks, and other Azure data services.
- Utilize Databricks for big data analytics and realtime data processing, ensuring optimal performance and efficiency.
- Collaborate with data architects to design and implement effective data models and architectures to support business requirements.
- Implement ETL processes for data extraction, transformation, and loading, ensuring the integrity and quality of the data.
- Integrate data from various sources, ensuring compatibility, accuracy, and adherence to data governance standards.
- Identify and address performance bottlenecks in data pipelines, optimizing for speed, reliability, and scalability.
- Work closely with crossfunctional teams, including data scientists, analysts, and business stakeholders, to understand data requirements and deliver effective solutions.
- Conduct code reviews, enforce best practices in coding and documentation, and mentor junior team members.
- Bachelor's or master's degree in Computer Science, Information Systems, or a related field.
- Minimum of 6 years of handson experience as a Data Engineer, with a focus on Azure Data Engineering and Databricks.
- Proficiency in Azure Data Factory, Azure Databricks, SQL, Python, and ETL processes.
- Solid understanding of data modelling, data warehousing, and big data concepts.
-
Data Engineer
3 days ago
SparkNet Innovations Mumbai, IndiaCompany Description · SparkNet is a trusted partner for businesses seeking to unlock the potential of data science and AI. They specialize in delivering end-to-end solutions that drive innovation, optimize operations, and fuel growth across diverse industries. With expertise in d ...
-
Data Engineer
1 week ago
NeerInfo Solutions Mumbai, IndiaThe ideal candidate will be responsible for conceptualizing and executing clear, quality code to develop the best software. You will test your code, identify errors, and iterate to ensure quality code. You will also support our customers and partners by troubleshooting any of the ...
-
Data Engineer
2 days ago
HTD Resources Mumbai, IndiaSkill: Data Engineer with Python knowledge · Designation : Software Engineer · Relevant Experience: 5 - 6 years · Mandatory Skills: · Primary Skills - Python, SQL, AWS, DWH Concept, ELT, · Secondary Skills - GCP, CDC · Location: Mumbai / Kolkata · Mode: Work from Office · Interv ...
-
Data Engineer
6 days ago
HR PLACEMENT CONSULTANTS (HRPC) Mumbai, IndiaPosition- Data Engineer · Location-Mumbai · Total Experience 4+ years · Domain/Vertical Insurance and / or Finance (preferred) · Qualifications Educational MSc/MCS/BE/B.Sc : Computer Science / Maths / IT · Certifications Data Engineering / Analytics / Databases etc. · Experie ...
-
Data Engineer
8 hours ago
HR PLACEMENT CONSULTANTS (HRPC) Mumbai, IndiaPosition- Data Engineer · Location-Mumbai · Total Experience 7+ years · Domain/Vertical Insurance and / or Finance (preferred) · Qualifications Educational MSc/MCS/BE/B.Sc : Computer Science / Maths / IT · Experience · • 7+ years of experience into Data Engineering. · • Experie ...
-
Data Engineer
1 week ago
Visionyle Solutions Mumbai/Kolkata, India permanentKey Responsibilities : · - Develop and maintain scalable data pipelines and ETL processes using Python, SQL, and other relevant technologies. · - Design and optimize data models for efficient storage and retrieval in data warehousing environments. · - Collaborate with cross-funct ...
-
Data Engineer
1 day ago
VARITE Inc. Mumbai, IndiaJob Title: Data Engineer · Location City : Hyderabad, bangalore, chennai, mumbai, new delhi, pune. · Experience Required : 4+ · Shift: Day Shift · Work Mode: Onsite · Position Type: Contract · Openings: 3 · Company Name : VARITE INDIA PRIVATE LIMITED · About The Client: A multina ...
-
Data Engineer
2 days ago
Versor Mumbai, IndiaJob Description : · The Data Engineer position will be based in Mumbai and be part of the Portfolio Analytics team. He / She will collaborate closely with senior researchers to design and develop a large-scale data lake. We are seeking candidates who have excelled in engineering ...
-
Data Engineer
1 day ago
Yo HR Consultancy Mumbai, IndiaRole : Data Engineer · Location : Mumbai · Experience : 2 - 4 years · Salary up to : 25 LPA · Must Have : · - Big Data · - Data Lake · - Apache · - Python/Java · Responsibilities : · - Collaborate with product owners to understand requirements and design new components. · - Colla ...
-
Data Engineer
1 day ago
HuQuo Mumbai, IndiaAs Data Engineer, your specific responsibilities include the following : · - Create and maintain optimal data pipeline architecture · - Assemble large, complex data sets that meet functional / non-functional business requirements · - Identify, design, and implement internal proce ...
-
Data Engineer
3 hours ago
Huquo Mumbai, IndiaPosition : Data Engineer · Location : Mumbai · Experience : 4-6 Years · Clairvoyant is a global technology consulting and services company founded in 2012, headquartered in Chandler, US, and have delivery centers across the globe. We help organizations maximize the value of data ...
-
Data Engineer
7 hours ago
Cyitechsearch Mumbai, IndiaJob Description : · Minimum experience 4 to 11 years. · Locations : Bangalore & Mumbai. · Max Notice Period : 45 Days. · Job Overview : · The role of Data Engineer involves leading complex business reengineering development projects and solving organizational problems through IT ...
-
Data Engineer
3 hours ago
XL Advisors Maharashtra, IndiaJob Description : · Qualification : · - Bachelors in Engineering (CS/IT) and above with a bent towards analytics. · Cloud certifications (AWS/Azure) will be a plus · Skills/ Experience : · - Ability to engage with stakeholders to understand business requirements and convert the s ...
-
Data Engineer
1 week ago
2coms Mumbai, India· Looking For Data Engineer Professionals For Global IT MNC @Mumbai · Greetings From 2COMS · Job Title: Data Engineer · Job Loc: Mumbai - Thane (WFO – 5 days) · Job Description : · Worked within data and data tools for the last 7 years. · Worked with tools from Microsoft like Az ...
-
Data Engineer
2 days ago
2coms Mumbai, IndiaJob Description · Looking For Data Engineer Professionals For Global IT MNC @Mumbai · Greetings From 2COMS · Job Title: Data Engineer · Job Loc: Mumbai - Thane (WFO – 5 days) · Job Description : · Worked within data and data tools for the last 7 years. · Worked with tools from Mi ...
-
Data Engineer
1 week ago
timesjobs Mumbai, India Full timePlease share your resume at ruchita.- · Experience: 4 Years · Location : Mumbai · Job Description: · 4 years (must) relavent experience in Bigdata and cloud technologies with can do attitude · Big data tools: Spark etc. · Relational SQL and NoSQL databases. · Data pipeline and wo ...
-
Sr Data Engineer
8 hours ago
VolgaInfotech Pvt. Ltd Mumbai, India** Looking for immediate joiners only ( within a week ). If interested, please revert back with your resume at along with your CTC / ECTC and Notice period **** · We are seeking a skilled Data Engineer to join our team. The ideal candidate will be responsible · for designing, im ...
-
Sr Data Engineer
8 hours ago
VolgaInfotech Pvt. Ltd Mumbai, India** Looking for immediate joiners only ( within a week ). If interested, please revert back with your resume along with your CTC / ECTC and Notice period **** · We are seeking a skilled Data Engineer to join our team. The ideal candidate will be responsible · for designing, implem ...
-
GCP Data Engineer
2 days ago
Quantiphi Mumbai, IndiaDesignation: Data Engineer · Experience Level: 4-15 Years · Location: Mumbai/Bangalore/Trivandrum · Role & Responsibilities: · In-depth knowledge and experience of GCP Data services : Bigquery / Dataproc / Composer / Pubsub / Dataflow / GCS/ BigTable · Must have proficient experi ...
-
Senior Data Engineer
1 week ago
AMINA Bank Mumbai, IndiaAbout AMINA · AMINA India is a wholly owned subsidiary of AMINA Bank AG, a licensed Swiss Bank focused on cryptocurrencies and digital assets. AMINA provides custody, trading, credit and investment products on cryptocurrencies and digital assets to institutional and professional ...
Senior Azure Data Engineer - Mumbai, India - Techno Wise
Description
Responsibilities :
Requirements :
Responsibilities :
Education :
Experience :
Technical Skills :