- Data Pipeline Development: Design, build, and maintain efficient and scalable data pipelines to process structured and unstructured data.
- AWS Cloud Services: Utilize AWS services such as S3, Lambda, CloudWatch, Kinesis, EMR, RDS and EC2 to store, process, and analyze large datasets.
- Data Integration: Collaborate with internal teams to integrate and consolidate data from various sources into a centralized data warehouse or data lake. This includes integrating third-party data sources via API, webhooks and automating the process of pushing data into your systems
- ETL Processes: Develop ETL (Extract, Transform, Load) processes for data integration and transformation, leveraging AWS tools like AWS Glue or custom Python/Scala scripts.
- Data Warehousing: Implement and manage data warehousing solutions, with experience in AWS Redshift or other cloud-based databases.
- Automation & Optimization: Automate data processing tasks and optimize the performance of data workflows.
- Collaboration: Work closely with data analysts and stakeholders to ensure that data solutions meet business requirements.
- Monitoring & Maintenance: Monitor data pipelines and ensure data availability, quality, and performance. Troubleshoot issues as needed.
- Documentation: Document data engineering processes, systems, pipelines, and workflows. Ensure all code, processes, and procedures are clearly explained and accessible for future reference or team members.
- Best Practices: Maintain high standards for code quality and documentation to ensure ease of collaboration, support, and long-term maintainability of data systems.
- Education: Bachelor's degree in Computer Science, Engineering, Mathematics, or a related field (or equivalent work experience).
- AWS Certifications (e.g. AWS Certified Data Engineer)
- Experience: 4+ years of experience in a data engineering role with a focus on AWS cloud services, infrastructure management, and data warehousing solutions
- Experience in integrating third-party systems and services via webhooks for data ingestion.
- Experience in developing ETL processes and working with large-scale datasets.
- Strong experience with SQL and database technologies, particularly in relational databases.
- 2+ years of experience in handling Postgres Database.
- Experience with Python, PySpark, Scala, or other programming languages for data engineering tasks.
- Proven ability to write clear, comprehensive documentation for complex data engineering systems and workflows.
- Version Control: Knowledge of Git or other version control systems
- Problem-Solving: Strong analytical and problem-solving skills.
- Documentation Tools: Familiarity with documentation tools like Confluence, Markdown, or Jupyter Notebooks for writing clear, organized technical documentation.
- Excellent communication skills to collaborate with cross-functional teams.
-
The Data Engineer is responsible for building and maintaining scalable, reliable, and high-performance data platforms. · ...
Mumbai, Maharashtra1 month ago
-
The role involves building and maintaining scalable data platforms. It includes designing data pipelines for batch and real-time processing using Spark, Python, related technologies. · Design, build and optimize data pipelines. · ...
Mumbai City1 month ago
-
As a Data Engineer you will work across a global team of analysts and data operation associates to develop new data technologies for Data Operations at PitchBook. · ...
Mumbai4 days ago
-
We are seeking a full-time Data Engineer to join our team at TopN Analytics. · Data Engineering experience. · Possess strong skills in SQL & Python. · ...
Mumbai, Maharashtra17 hours ago
-
If building scalable data infrastructure excites you this is the place to be Fornax is a team of cross-functional individuals who solve critical business challenges using analytics and innovative data solutions We are seeking a skilled Data Engineer to work on our cutting-edge da ...
Mumbai, Maharashtra1 month ago
-
We are looking for a skilled Data Engineer with hands-on experience in building, optimizing, and maintaining scalable data pipelines. · - Design, develop, · & maintain scalable data pipelines using PySpark. · - Orchestrate and schedule workflows using Apache Airflow. · - Develop ...
Mumbai1 month ago
-
We are seeking a skilled and motivated Data Engineer to design, build, and maintain robust data systems that power analytics, · reporting,and business decision-making. · ...
Mumbai Full time20 hours ago
-
Develop and optimize robust, scalable data pipelines using PySpark and Python. · ...
Mumbai Full time6 days ago
-
Data Engineer identifies the business problem and translates these to data services and engineering outcomes. · As a Data Engineer, you are a full-stack data engineer that loves solving business problems. · You will deliver data solutions that empower better decision making and f ...
Mumbai, Pune1 week ago
-
Veeva is looking for data engineer to create high-quality solutions to complex problems around data acquisition and integration. · ...
Mumbai Full time6 days ago
-
We are building a world-class language-related product that has the potential to positively transform lives worldwide. · Create, build and design data management systems across an entire organization · Work with very large data sets (both structured and unstructured). · Help data ...
Mumbai, Maharashtra, India1 week ago
-
We are looking for a highly motivated and passionate Junior Data Engineer to join our growing data team. · Strong aptitude, logical reasoning, and problem-solving skills. · ...
Mumbai, Maharashtra3 weeks ago
-
Build a centralized data system/warehouse for unifying data, improving data integration, and enhancing reporting and business intelligence capabilities. · Design & implement a centralized data integration process to merge data from multiple disconnected systems. · Generate data r ...
Mumbai1 month ago
-
Develop and integrate data driven products & solutions for front office analytics and data science. · We are hiring a Data Engineer to develop, · integrate and support Data Driven Products & Solutions for Front Office Analytics · and Data Science. The role focuses on end-to-end o ...
Mumbai3 weeks ago
-
+Data Engineer (Automation Testing) required with 4-8 years of experience in software engineering and test automation. · ...
Mumbai1 month ago
-
You will sit at the core of complex, high-impact delivery programmes for global clients across financial crime, fraud, risk and customer intelligence. · ...
Maharashtra, Mumbai, India17 hours ago
-
The Data Engineer will be responsible for building scalable data platforms on AWS with a strong focus on ETL/ELT pipelines and data warehousing. · ...
Mumbai1 month ago
-
We are looking for a snowfalke developer role with 5+ years experince in SQL and data rngineering to join our dynamic team. · 5+ years of hands on experince in SQL, data engineering and working with Snowflake · Practical knowledge of Azure Data Factour and Python scripting · Stro ...
Mumbai, Maharashtra2 weeks ago
-
This is a data engineering position that involves building and maintaining data pipelines using Azure Data Lake, Databricks, ETL/ELT. · ...
Mumbai Full time6 days ago
-
Data Engineer with 6+ years of experience in implementing large data-warehousing projects. Skilled in GCP, Data Engineering, Big Query and Python. · ...
Mumbai1 month ago
-
We are looking for a passionate and experienced Data Engineer to join our team and help build scalable, reliable, and efficient data pipelines on cloud platforms like Primarily on Google Cloud Platform (GCP) and secondary on Amazon Web Services (AWS). · Design, · develop, · main ...
Mumbai, Maharashtra2 weeks ago
Data Engineer - Mumbai - mCaffeine
Description
Company overview:
PEP is a dynamic personal care company that proudly houses two innovative brands – mCaffeine & Hyphen. With a passion for creating high-performance, conscious, and consumer-loved products, we are redefining the way personal care is experienced. While mCaffeine is India's first caffeinated personal care brand, loved for its energizing and playful approach, Hyphen is built on the philosophy of simplifying skincare through science-backed formulations. Together, our brands reflect PEP's mission to deliver quality, creativity, and care to millions of consumers. We believe in Confidence over all skin & body biases.
Come, join the pack
About the role:
We are seeking a highly skilled Data Engineer with hands-on experience in AWS cloud services to join our team. The ideal candidate will be responsible for building and maintaining scalable data pipelines, integrating data systems, and ensuring data integrity and availability. You will work closely with data analysts and stakeholders to support the company's data-driven decision-making processes. Strong documentation skills are also essential to ensure that processes, pipelines, and systems are clearly defined and easily understood by both technical and non-technical stakeholders.
Key Responsibilities:
Qualifications and Skills:
-
Data Engineer – Data
Only for registered members Mumbai, Maharashtra
-
Data Engineer – Data
Only for registered members Mumbai City
-
Data Engineer
Only for registered members Mumbai
-
Data Engineer
Only for registered members Mumbai, Maharashtra
-
Data Engineer
Only for registered members Mumbai, Maharashtra
-
Data Engineer
Only for registered members Mumbai
-
Data Engineer
Full time Only for registered members Mumbai
-
Data Engineer
Full time confidential- Mumbai
-
Data Engineer
Only for registered members Mumbai, Pune
-
Data Engineer
Full time confidential- Mumbai
-
Data Engineer
Only for registered members Mumbai, Maharashtra, India
-
Data Engineer
Only for registered members Mumbai, Maharashtra
-
Data Engineer
Only for registered members Mumbai
-
Data Engineer
Only for registered members Mumbai
-
Data Engineer
Only for registered members Mumbai
-
Data Engineer
Only for registered members Maharashtra, Mumbai, India
-
Data Engineer
Only for registered members Mumbai
-
Data Engineer
Only for registered members Mumbai, Maharashtra
-
Data Engineer
Full time confidential- Mumbai
-
Data Engineer
Only for registered members Mumbai
-
Data Engineer
Only for registered members Mumbai, Maharashtra