- Designing, constructing, and maintaining scalable data pipelines to ingest, process, and transform data from various sources, such as databases, APIs, logs, and streaming platforms
- Designing and implementing data models and architectures that support the storage, retrieval, and analysis of large volumes of data efficiently
- Developing ELT/ETL processes to clean, transform, and aggregate raw data into formats suitable for analysis and reporting
- Managing data infrastructure, including databases, servers, and cloud services, to ensure high availability, reliability, and scalability
- Monitor data quality and ensure data accuracy and consistency throughout the data lifecycle
- Documenting data pipelines, processes, and best practices to facilitate knowledge sharing
- Effectively collaborate with Business , PM , Tech Teams etc.
- Provide operational support to Production systems
- Daily monitoring of systems for performance , errors , anomalies
- Able to work extra hours and occasional weekends for system hardware changes, respond to emergencies and project Go Live
- Bachelor's Degree in computer science, information technology, or related discipline
- 3 to 5 years of Data Engineering / Data Warehousing experience
- 3+ years of Python or Java development experience
- 3+ years of SQL experience (No-SQL experience is a plus)
- 3+ years of experience with schema design and dimensional data modelling
- Experience designing, building, and maintaining data processing systems
- Experience working with either a Map Reduce or an MPP system on any size/scale
- Strong knowledge of the Linux operating system
- Knowledge of BI Reporting tool like Tableau, PowerBI, SSRS is a plus
- Functional experience with software development lifecycle (SDLC).
- Experience with source control application git
- Experience working on public cloud platform AWS/Azure/GCP
- Experience working with dockerized applications is a plus
- Experience working with Infrastructure as Code using AWS CloudFormation/Terraform is a plus
-
BIU:Data Engineer-ETB Database Lending
6 hours ago
Axis Bank Mumbai, IndiaBIU:Data Engineer-ETB Database Lending · 0 - 1 Years · 1 Opening · Mumbai · Role description · To update · Skills · Excel · ...
-
Data Engineer
5 days ago
SparkNet Innovations Mumbai, IndiaCompany Description · SparkNet is a trusted partner for businesses seeking to unlock the potential of data science and AI. They specialize in delivering end-to-end solutions that drive innovation, optimize operations, and fuel growth across diverse industries. With expertise in d ...
-
Data Engineer
1 day ago
Erobern Consulting Mumbai, IndiaWe are hiring Data Engineers for one of our MNC client in Finance Domain: · Experience - 5 Years -10 years · Worked on real time data ingestion use cases in DataBricks · Good knowledge on PySpark. · Realtime streaming using Spark. · Complex platform transformation · Should have D ...
-
Data Engineer
2 days ago
Huquo Mumbai, IndiaPosition : Data Engineer · Location : Mumbai · Experience : 4-6 Years · Clairvoyant is a global technology consulting and services company founded in 2012, headquartered in Chandler, US, and have delivery centers across the globe. We help organizations maximize the value of data ...
-
Data Engineer
1 week ago
NeerInfo Solutions Mumbai, IndiaThe ideal candidate will be responsible for conceptualizing and executing clear, quality code to develop the best software. You will test your code, identify errors, and iterate to ensure quality code. You will also support our customers and partners by troubleshooting any of the ...
-
Data Engineer
4 days ago
Versor Mumbai, IndiaJob Description : · The Data Engineer position will be based in Mumbai and be part of the Portfolio Analytics team. He / She will collaborate closely with senior researchers to design and develop a large-scale data lake. We are seeking candidates who have excelled in engineering ...
-
Data Engineer
1 week ago
HR PLACEMENT CONSULTANTS (HRPC) Mumbai, IndiaPosition- Data Engineer · Location-Mumbai · Total Experience 4+ years · Domain/Vertical Insurance and / or Finance (preferred) · Qualifications Educational MSc/MCS/BE/B.Sc : Computer Science / Maths / IT · Certifications Data Engineering / Analytics / Databases etc. · Experie ...
-
Data Engineer
4 days ago
HTD Resources Mumbai, IndiaSkill: Data Engineer with Python knowledge · Designation : Software Engineer · Relevant Experience: 5 - 6 years · Mandatory Skills: · Primary Skills - Python, SQL, AWS, DWH Concept, ELT, · Secondary Skills - GCP, CDC · Location: Mumbai / Kolkata · Mode: Work from Office · Interv ...
-
Data Engineer
3 days ago
HuQuo Mumbai, IndiaAs Data Engineer, your specific responsibilities include the following : · - Create and maintain optimal data pipeline architecture · - Assemble large, complex data sets that meet functional / non-functional business requirements · - Identify, design, and implement internal proce ...
-
Data Engineer
2 days ago
HR PLACEMENT CONSULTANTS (HRPC) Mumbai, IndiaPosition- Data Engineer · Location-Mumbai · Total Experience 7+ years · Domain/Vertical Insurance and / or Finance (preferred) · Qualifications Educational MSc/MCS/BE/B.Sc : Computer Science / Maths / IT · Experience · • 7+ years of experience into Data Engineering. · • Experie ...
-
Data Engineer
2 days ago
XL Advisors Maharashtra, IndiaJob Description : · Qualification : · - Bachelors in Engineering (CS/IT) and above with a bent towards analytics. · Cloud certifications (AWS/Azure) will be a plus · Skills/ Experience : · - Ability to engage with stakeholders to understand business requirements and convert the s ...
-
Data Engineer
1 week ago
Visionyle Solutions Mumbai/Kolkata, India permanentKey Responsibilities : · - Develop and maintain scalable data pipelines and ETL processes using Python, SQL, and other relevant technologies. · - Design and optimize data models for efficient storage and retrieval in data warehousing environments. · - Collaborate with cross-funct ...
-
data engineer
10 hours ago
OIL FIELD INSTRUMENTATION Mumbai, IndiaExperience : 4+ years of Mud Logging experience as Data Engineer in India and abroad, both onshore and offshore rig operations. Deep Water experience will be an advantage. Proficient with real-time data monitoring and data management, WITSML transmission, gas detection and analy ...
-
Data Engineer
3 days ago
VARITE Inc. Mumbai, IndiaJob Title: Data Engineer · Location City : Hyderabad, bangalore, chennai, mumbai, new delhi, pune. · Experience Required : 4+ · Shift: Day Shift · Work Mode: Onsite · Position Type: Contract · Openings: 3 · Company Name : VARITE INDIA PRIVATE LIMITED · About The Client: A multina ...
-
Data Engineer
3 days ago
Yo HR Consultancy Mumbai, IndiaRole : Data Engineer · Location : Mumbai · Experience : 2 - 4 years · Salary up to : 25 LPA · Must Have : · - Big Data · - Data Lake · - Apache · - Python/Java · Responsibilities : · - Collaborate with product owners to understand requirements and design new components. · - Colla ...
-
Data Engineer
4 days ago
2coms Mumbai, IndiaJob Description · Looking For Data Engineer Professionals For Global IT MNC @Mumbai · Greetings From 2COMS · Job Title: Data Engineer · Job Loc: Mumbai - Thane (WFO – 5 days) · Job Description : · Worked within data and data tools for the last 7 years. · Worked with tools from Mi ...
-
Data Engineer
2 days ago
Cyitechsearch Mumbai, IndiaJob Description : · Minimum experience 4 to 11 years. · Locations : Bangalore & Mumbai. · Max Notice Period : 45 Days. · Job Overview : · The role of Data Engineer involves leading complex business reengineering development projects and solving organizational problems through IT ...
-
Data Engineer
10 hours ago
Virtusa Mumbai, IndiaData Engineer - CREQ187220 Description 6-8 years of relevant work experience showing growth as a Data Engineer. · Hands On programming experience · Implementation Experience on Kafka, Kinesis, Spark, AWS Glue, AWS LakeFormation. · Experience of performance optimization in Batch a ...
-
Data Engineer
1 day ago
ISS | Institutional Shareholder Services Mumbai, India Full timeLet's be #BrilliantTogether · ISS STOXX is looking for a Data Engineer to join ourteam in Mumbai, India. · Overview: · We are looking for a talent to bring technical expertise to the development and deployment of our cutting-edge financial intelligence platform. In this role, ...
-
Data Engineer
1 week ago
timesjobs Mumbai, India Full timePlease share your resume at ruchita.- · Experience: 4 Years · Location : Mumbai · Job Description: · 4 years (must) relavent experience in Bigdata and cloud technologies with can do attitude · Big data tools: Spark etc. · Relational SQL and NoSQL databases. · Data pipeline and wo ...
Data Engineer - Mumbai, India - Newfold Digital
Description
Data EngineerJOB DESCRIPTION
Newfold Digital is looking for a seasoned Data Engineer. This role will participate in all aspects of the development lifecycle, from scoping and requirements to solutioning, implementation and support. The ideal candidate would have extensive experience developing and supporting a DW service comprised of multiple Data Warehouses and ELT applications. The Data Engineer will contribute to the evolution of the processes and standards necessary to enable the development team to deliver quality, compliant, and timely solutions. The right candidate will have in-depth experience with Data Engineering, programming, ETL/ELT process, Database Management Systems (DBMS) – relational and dimensional, and an innovative/energetic mindset focused on delivering business value through collecting, organizing, structuring and storing data as a strategic asset. Additionally, the candidate must possess exceptional written and verbal communication skills. The Data Engineer is responsible for the working as a team with BI Developers, Data Analyst, and Data Engineers, to ensure enterprise data warehouse and repositories are built with high performance, availability and scalability standards.
ESSENTIAL DUTIES AND RESPONSIBILITIES
EDUCATION and EXPERIENCE
REQUIRED SKILLS