Data Engineer - Mumbai, India - Puma Energy

Puma Energy Mumbai, India

1 day ago

Description

Main Purpose:

Collaborate with data scientists and business stakeholders to design, develop, and maintain efficient data pipelines feeding into the organization's data lake.

Ensure the data lake contains accurate, up-to-date, and high-quality data, enabling data scientists to develop insightful analytics and business stakeholders to make well-informed decisions.

Utilize expertise in data engineering and cloud technologies to contribute to the overall success of the organization by providing the necessary data infrastructure and fostering a data-driven culture.

Demonstrate a strong architectural sense in defining data models, leveraging the Poly-base concept to optimize data storage and access.
Facilitate seamless data integration and management across the organization, ensuring a robust and scalable data architecture.
Take responsibility for defining and designing the data catalogue, effectively modelling all data within the organization, to enable efficient data discovery, access, and management for various stakeholders
Knowledge Skills and Abilities, Key Responsibilities:

KEY RESPONSIBILITIES
Design, develop, optimize, and maintain data architecture and pipelines that adhere to ETL principles and business goals.
Develop complex queries and solutions using Scala, .NET, Python/PySpark languages.
Implement and maintain data solutions on Azure Data Factory, Azure Data Lake, and Databricks
Create data products for analytics and data scientist team members to improve their productivity.
Advise, consult, mentor, and coach other data and analytic professionals on data standards and practices.
Foster a culture of sharing, re-use, design for scale stability, and operational efficiency of data and analytical solutions.

Lead the evaluation, implementation, and deployment of emerging tools and processes for analytic data engineering in order to improve our productivity as a team.

Develop and deliver communication and education plans on analytic data engineering capabilities, standards, and processes.
Partner with business analysts and solutions architects to develop technical architectures for strategic enterprise projects and initiatives.
Collaborate with other team members and effectively influence, direct, and monitor project work.
Develop strong understanding of the business and support decision making.

REQUIREMENTS
Experience:

10 years of overall experience & at least 5 years of relevant experience
5 years of experience working with Azure data factory & data bricks
Skills

:

Bachelor's degree required; Computer Science Engineering.
5+ years of experience working in data engineering or architecture role.
Expertise in SQL and data analysis and experience with at least one programming language (Scala and .NET preferred).
Experience developing and maintaining data warehouses in big data solutions.
Experience with, Azure Data Lake, Azure Data Factory, and Databricks) in the data and analytics space is a must

Database development experience using Hadoop or Big Query and experience with a variety of relational, NoSQL, and cloud data lake technologies.

Worked with BI tools such as Tableau, Power BI, Looker, Shiny.

Conceptual knowledge of data and analytics, such as dimensional modelling, ETL, reporting tools, data governance, data warehousing, and structured and unstructured data.

Big Data Development experience using Hive, Impala, Spark, and familiarity with Kafka.
Exposure to machine learning, data science, computer vision, artificial intelligence, statistics, and/or applied mathematics.
Languages:

Fluency in verbal and written English mandatory.
Fluency is Spanish & French is useful.

Key Relationships and Department Overview:

KEY RELATIONSHIPS
Internal:

CEO & COO of Africa, managers across various departments, Senior Management, Head of Departments in other regional hubs of Puma Energy
External:

External Consultants

BIU:Data Engineer-ETB Database Lending

1 day ago

Axis Bank Mumbai, India

· BIU:Data Engineer-ETB Database Lending · 0 - 1 Years · 1 Opening · Mumbai · Role description · To update · Skills · Excel ...
Data Engineer

6 days ago

SparkNet Innovations Mumbai, India

Company Description · SparkNet is a trusted partner for businesses seeking to unlock the potential of data science and AI. They specialize in delivering end-to-end solutions that drive innovation, optimize operations, and fuel growth across diverse industries. With expertise in d ...
Data Engineer

1 day ago

Erobern Consulting Mumbai, India

We are hiring · Data Engineers · for one of our MNC client in Finance Domain: · Experience - 5 Years -10 years · Worked on real time data ingestion use cases in · DataBricks · Good knowledge on · PySpark. · Realtime streaming using Spark. · Complex platform transformation · Shoul ...
Data Engineer

1 day ago

HR PLACEMENT CONSULTANTS (HRPC) Mumbai, India

Position- Data Engineer · Location-Mumbai · Total Experience 7+ years · Domain/Vertical Insurance and / or Finance (preferred) · Qualifications Educational  MSc/MCS/BE/B.Sc : Computer Science / Maths / IT · Experience · • 7+ years of experience into Data Engineering. · • Experie ...
Data Engineer

1 day ago

Antal International Mumbai, India

A leading Indian logistics champion: · Consistently ranked among the top 3 most profitable logistics companies in India, this powerhouse boasts impressive revenue (think ₹ 10,000 Crore) and a strong profit growth rate. Their commitment to innovation is evident in achievements lik ...
Data Engineer

1 day ago

HTD Resources Mumbai, India

Skill: · Data Engineer with Python knowledge · Designation : · Software Engineer · Relevant Experience: · 5 - 6 years · Mandatory Skills: · Primary Skills - Python, SQL, AWS, DWH Concept, ELT, · Secondary Skills - GCP, CDC · Location: · Mumbai / Kolkata · Mode: · Work from Office ...
Data Engineer

1 day ago

Huquo mumbai, India

Position : Data Engineer · Location : Mumbai · Experience : 4-6 Years · Clairvoyant is a global technology consulting and services company founded in 2012, headquartered in Chandler, US, and have delivery centers across the globe. We help organizations maximize the value of data ...
Data Engineer

1 week ago

Visionyle Solutions Mumbai/Kolkata, India permanent

Key Responsibilities : · - Develop and maintain scalable data pipelines and ETL processes using Python, SQL, and other relevant technologies. · - Design and optimize data models for efficient storage and retrieval in data warehousing environments. · - Collaborate with cross-funct ...
Data Engineer

1 day ago

Neer Info mumbai, India

About the job : · - The ideal candidate will be responsible for conceptualizing and executing clear, quality code to develop the best software. · - You will test your code, identify errors, and iterate to ensure quality code. · - You will also support our customers and partners ...
Data Engineer

1 day ago

Aunalytics mumbai, India

Position Overview · Data Engineers are data experts who dive right into new client projects and make it their job to understand how a client's data fits into our Industry Intelligent data models. Utilizing this knowledge and the industry's newest technologies, they create high ...
Data Engineer

1 day ago

Domnic Lewis International Mumbai, India

Key Deliverables : · 1. Implement data ingestion processes to extract data from various sources, including databases, APIs, and streaming platforms. · 2. Develop and maintain Extract, Transform, Load (ETL) pipelines using AWS Glue, AWS Lambda, or custom scripts. · 3. Perform dat ...
Data Engineer

1 day ago

2coms Mumbai, India

· Greetings From 2COMS · Job Title:Data Engineer · Job Loc: Mumbai - Thane (WFO – 5 days) · Job Description : · Worked within data and data tools for the last 7 years. · Worked with tools · from Microsoft like Azure Synapse, and Azure DataBricks. · Exp in · Azure services like K ...
Data Engineer

1 day ago

Sterlite Technologies Limited mumbai, India

Role as a Data engineer : · - Develop and build AI/ML model ready data ponds using Azure Databricks Delta lake · - Improve upon the data ingestion models, ETL jobs, and alarm to maintain data integrity and data availability. · - Partner with AI/ML product teams proactively identi ...
Data Engineer

1 day ago

RapidBraiins mumbai, India permanent

Position Overview : · As a Talend - Data Engineering Specialist, you will play a key role in designing, developing, and maintaining data pipelines using Talend, AWS, and SQL. You will work closely with cross-functional teams to gather requirements, design data solutions, and impl ...
Data Engineer

1 day ago

Teksands mumbai, India

Job Description : · 8+ years of analysis and reporting business intelligence-related needs. · - Must have : Excellent Data warehousing, data modeling, and data transformation · - Advanced SQL ,Tableau Reporting ,Design stable, reliable, and effective databases. · - Interface wit ...
Data Engineer

1 day ago

Ten Group mumbai, India

Overview · We are looking for someone that can create a systematic ETL approach to plan and maintain data architecture while keeping it aligned with business requirements. Additional to this, support the data team in improving the process to store optimized datasets, the analyt ...
Data Engineer

1 week ago

NeerInfo Solutions Mumbai, India

The ideal candidate will be responsible for conceptualizing and executing clear, quality code to develop the best software. You will test your code, identify errors, and iterate to ensure quality code. You will also support our customers and partners by troubleshooting any of the ...
Data Engineer

1 day ago

TransOrg Analytics Mumbai, India

Location · : Gurgaon/Mumbai · Job ID · : DE2008 · Job Type · : Full time · Experience · : 2-6 years · Why would you like to join us? · TransOrg Analytics, an award winning – Big Data and Predictive analytics- company, offers advanced analytics solutions to industry leaders and Fo ...
Data Engineer

1 day ago

Aunalytics Mumbai, India

Position OverviewData Engineers are data experts who dive right into new client projects and make it their job to understand how a client's data fits into our Industry Intelligent data models. Utilizing this knowledge and the industry's newest technologies, they create high perfo ...
Data Engineer

1 week ago

HR PLACEMENT CONSULTANTS (HRPC) Mumbai, India

Position- Data Engineer · Location-Mumbai · Total Experience 4+ years · Domain/Vertical Insurance and / or Finance (preferred) · Qualifications Educational  MSc/MCS/BE/B.Sc : Computer Science / Maths / IT · Certifications  Data Engineering / Analytics / Databases etc. · Experie ...