- Design and implement scalable and efficient data processing pipelines using Apache Spark and Java.
- Develop APIs and services for data ingestion, transformation, and aggregation to support analytics and machine learning models.
- Collaborate with data scientists, analysts, and cross-functional teams to understand data requirements and deliver innovative data solutions.
- Optimize Spark jobs for performance and cost efficiency across large datasets.
- Ensure high data quality and integrity by implementing robust testing and validation practices.
- Lead the adoption of best practices in code quality, CI/CD, and DevOps within the data engineering team.
- Mentor junior developers and contribute to knowledge sharing and team development.
- Bachelor's or Master's degree in Computer Science, Engineering, or a related field.
- Proficient in Java programming and familiar with the Scala programming language.
- Strong experience in designing and implementing scalable data processing pipelines using Apache Spark and Java.
- Solid understanding of big data technologies and ecosystems (HDFS, YARN, Kafka, HBase, etc.).
- Familiarity with DevOps tools and practices, including Docker, Kubernetes, Jenkins, and Git.
- Excellent problem-solving skills, with the ability to tackle challenges in large-scale data environments.
- Strong communication and collaboration skills, with the ability to work effectively in a team and interface with technical and non-technical stakeholders.
- A dynamic and challenging work environment.
- Opportunities for personal and professional growth.
-
Data Specialist
6 hours ago
Moody's Bengaluru, IndiaAt Moody's, we unite the brightest minds to turn today's risks into tomorrow's opportunities. We do this by striving to create an inclusive environment where everyone feels welcome to be who they are—with the freedom to exchange ideas, think innovatively, and listen to each other ...
-
Master Data Specialist
4 days ago
Selections HR Services Private Limited Bengaluru, IndiaPosition: Master Data Specialist · Base Location: Bangalore · Experience: 3 To 10 Yrs · Shift: Open to Shifts · Role: · The Master Data Specialist will be responsible for executing day-to-day activities pertaining to supply chain Master Data operations within the Oil & Gas indust ...
-
Data Annotation Specialist
16 hours ago
Microsoft Bengaluru, India Full timeOverview · Microsoft Anticorruption, Trade & Risk and AI Operations (ATR & AIO) ensures the business ecosystem of processes, organizations and systems effectively enable Microsoft and 3rd Parties to conduct business in a compliant and ethical manner. We incorporate trade complia ...
-
Specialist - Data Engineering
3 days ago
LTIMindtree Bengaluru, IndiaSpecialist - Data Engineering · Job Req Id: Azure,Pyspark, Kafka, Spark, SQL ,PythonMin Salary: Max Salary:Job Segment: · Database, SQL, Engineer, Technology, Engineering ...
-
Data Entry Specialist
2 days ago
Procucev Bengaluru, India ContractCompany Overview · Procucev is a pioneering Enterprise Digital Procurement Company providing 360-degree solutions, automating procurement processes, offering consulting services, and managing procurement for cost savings. With 11-50 employees, Procucev excels in Business Supplies ...
-
Data Annotation Specialist
3 days ago
Microsoft Bengaluru, IndiaOverview · Microsoft Risk, Trust, and Safety Operations (RTS & AIO) ensures the business ecosystem of processes, organizations and systems effectively enable Microsoft and 3rd Parties to conduct business in a compliant and ethical manner. We incorporate trade compliance requireme ...
-
Specialist - Data Sciences
6 hours ago
LTIMindtree Bengaluru, IndiaSpecialist - Data Sciences · Job Req Id: About Fosfor : · Job Title: Data Scientist · Work Location: Chennai · Experience 5-8 Years · Work Mode: Hybrid (2 days at office in a week) · Lead AI Engineer (NLP) · We are looking for a passionate NLP enthusiast who will be contributing ...
-
Data Migration Specialist
18 hours ago
Allime Tech Solutions Bangalore, India permanentJob Description : · As a Data Migration Specialist, you will be responsible for designing, planning, and executing data migration activities for SAP implementation projects. You will work closely with clients and internal teams to extract, transform, and load data from legacy sys ...
-
Data Collection Specialist
6 hours ago
Bloom Energy Bengaluru, India Full timeBloom Energy is the leading force in transforming the way energy is generated and delivered. We are driving toward the parallel goals of growing a dynamic and forward-thinking company while creating a positive impact on our environment. Our mission is to make clean, reliable ener ...
-
Data Migration Specialist
6 hours ago
Dautom Bengaluru, India Full timeClient Introduction: · In this role, you will have the opportunity to work closely with one of our esteemed clients, known for its commitment to quality and innovation. They have chosen Dautom as their trusted partner for their upcoming projects. · Job Title: Data Migration Speci ...
-
Data Migration Specialist
6 days ago
Whizz HR Bangalore, India permanentJob Summary : · As a Data Migration Specialist, you will play a critical role in ensuring a smooth transition of customers monitoring and observability infrastructure. · Your expertise in various other observability tools, coupled with a strong understanding of PromQL, will be es ...
-
Big Data Specialist
5 days ago
Sigmoid Bengaluru, IndiaSigmoid works with a variety of clients from start-ups to fortune 500 companies. We are · looking for a detailed oriented self-starter to assist our engineering and analytics teams in · various roles as a Software Development Engineer. · This position will be a part of a growing ...
-
Platform Data Specialist
3 days ago
timesjobs Bengaluru/ Bangalore, India Full time· As a Platform Data team member, you will join the Technology team, a group of highly skilled individuals working to protect enterprise-level commercial customers from digital risk. Using our proprietary platform, this role focuses on supporting our Platform Specialist team by ...
-
Data Migration Specialist
1 day ago
Dautom Bengaluru, IndiaClientIntroduction: · In this role youwill have the opportunity to work closely with one of our esteemedclients known for its commitment to quality and innovation. Theyhave chosen Dautom as their trusted partner for their upcomingprojects. · Job Title: DataMigration Specialist · ...
-
Big Data Specialist
4 days ago
o9 Solutions, Inc. Bengaluru, IndiaBe part of something revolutionary. · At o9 Solutions, our mission is clear: be the Most Valuable Platform (MVP) for enterprises. With our AI-driven platform — the o9 Digital Brain — we integrate global enterprises' siloed planning capabilities, helping them capture millions and, ...
-
Data Integration Specialist
6 days ago
Trinity Technology Solutions LLC Bengaluru, IndiaSoft Skills: The candidate must possess strong communication and leadership skills, as they will need to present results to both clients and the business. They should be action-oriented, capable of making decisions, and skilled in troubleshooting issues. · Technical Skills: · Pri ...
-
Data Science Specialist
3 days ago
Applicantz Bengaluru, IndiaTHIS IS A LONG TERM CONTRACT POSITION WITH ONE OF THE LARGEST, GLOBAL, TECHNOLOGY LEADER. · Our large, Fortune client is ranked as one of the best companies to work with, in the world. The client fosters progressive culture, creativity, and a Flexible work environment. They use ...
-
Big Data Specialist
3 days ago
o9 Solutions, Inc. Bengaluru, IndiaBe part of something revolutionary. · At o9 Solutions, our mission is clear: be the Most Valuable Platform (MVP) for enterprises. With our AI-driven platform — the o9 Digital Brain — we integrate global enterprises' siloed planning capabilities, helping them capture millions and, ...
-
Big Data Specialist
1 day ago
Sigmoid Bengaluru, IndiaSigmoid works with a variety of clients from start-ups to fortune 500 companies. We arelooking for a detailed oriented self-starter to assist our engineering and analytics teams invarious roles as a Software Development Engineer.This position will be a part of a growing team work ...
-
Data Integration Specialist
1 day ago
Trinity Technology Solutions LLC Bengaluru, IndiaSoft Skills: · The candidate must possess strong communication and leadership skills, as they will need to present results to both clients and the business. They should be action-oriented, capable of making decisions, and skilled in troubleshooting issues. · Technical Skills:Prim ...
Big Data Specialist - Bengaluru, India - Tavant
Description
With 24+ years of experience building innovative digital products and solutions, Tavant provides impactful results to its customers. It has been the frontrunner in driving digital innovation and tech-enabled transformation across a wide range of industries such as Fintech, Manufacturing, Agtech, Media & Entertainment, and Retail in North America, Europe, and Asia-Pacific.
Powered by Artificial Intelligence and Machine Learning algorithms, we help our customers improve operational efficiency, productivity, speed, and accuracy. Our suite of products and solutions is routinely rated high by the industry.
Ours is a challenging workplace where teams are diverse, competitive, and continually searching for tomorrow's technology and brilliant minds to create it. Furthermore, we do not focus just on what we do – we also care how we do it. So, bring your talent and ambition to make a difference. We will create a world of opportunities for you.
Job Details
Job Title: Big Data Engineer
Location: Bangalore / Noida / Hyderabad
Quick joiners needed
Job Responsibilities:
Qualification:
What We Offer: