- Cluster Management: Design, implement, and manage large-scale Hadoop clusters to support business data requirements.
- Configuration & Tuning: Configure and optimize Hadoop components, including HDFS, MapReduce, YARN, and Hive, for maximum performance and stability.
- ETL Development: Develop and maintain custom applications and scripts to extract, transform, and load (ETL) data into the Hadoop ecosystem.
- Integration: Integrate Hadoop with other Big Data tools and technologies to enable comprehensive data solutions.
- Maintenance & Upgrades: Perform regular maintenance, patching, and version upgrades to ensure cluster reliability and high availability.
- Monitoring & Troubleshooting: Continuously monitor Hadoop environments, identify potential issues, and resolve technical problems promptly.
- Collaboration: Work closely with data scientists, analysts, and other teams to understand data processing needs and optimize Hadoop usage.
- Documentation: Maintain detailed documentation of configurations, processes, and best practices.
- Bachelor's degree in Computer Science, Information Technology, or a related field.
- Proven experience in Hadoop administration, implementation, and troubleshooting.
- Experience with Big Data technologies such as Hive, Pig, Spark, or HBase is a plus.
-
This is a full-time hybrid role for a Big Data Engineer specializing in Hadoop and Google Cloud Platform (GCP). The role is based in Pune, with flexibility for part-time remote work. · ...
Pune, Maharashtra1 month ago
- Work in company
Data Analyst-Data Management and Analytics-Data Ops/Data Analyst
Only for registered members
Data Analyst-Data Management and Analytics-Data Ops/Data Analyst · 5 - 9 years of professional experience as a Data Analyst with good decision-making, analytical and problem-solving skills. · Working knowledge / experience of Big Data frameworks like Hadoop, Hive and Spark. · ...
Pune Full time3 weeks ago
-
· Job Description: · Project Role : Application Lead Project Role Description : Lead the effort to design, build and configure applications, acting as the primary point of contact Must have Skills : Bigdata Analytics Architecture and Design Good to Have Skills : Scala Program ...
Pune2 days ago
-
We are looking for a skilled professional with expertise in Spark-Scala to join our team on a contract-to-hire basis. · Design, develop and implement scalable data processing pipelines using Spark-Scala. · Collaborate with cross-functional teams to identify and prioritize project ...
Pune1 month ago
-
As Data Engineer, you will develop, maintain, evaluate and test big data solutions. You will be involved in the development of data solutions using Spark Framework with Python or Scala on Hadoop and AWS Cloud Data Platform. · ...
Pune2 weeks ago
-
As Data Engineer you will develop and maintain big data solutions. You will be involved in the development of data solutions using Spark Framework with Python or Scala on Hadoop and AWS Cloud Data Platform. · ...
Pune1 month ago
-
+This is a full-time hybrid role based in Pune for a GCP Data Engineer (Hadoop Ecosystem). The role involves designing and implementing data pipelines, managing data platforms, and supporting Extract, Transform, Load (ETL) processes. · ...
Pune, Maharashtra1 month ago
-
We are seeking a highly skilled and motivated PySpark Manager to lead our data engineering initiatives. · Lead and mentor a team of data engineers, ensuring high performance and professional growth. · Oversee project timelines, quality, and deliverables for multiple data initiati ...
Pune Full time1 week ago
-
Introduction · In this role, you'll work in one of our IBM Consulting Client Innovation Centers (Delivery Centers), where we deliver deep technical and industry expertise to a wide range of public and private sector clients around the world. Our delivery centers offer our clients ...
Pune, India Full time6 days ago
-
Job Title: GCP Big Data Engineer · Location: Pune · Work Mode: Hybrid · Experience: 3 – 5 Years · Employment Type: Full-time · About the Role · We are looking for a skilled · GCP Big Data Engineer · with strong hands-on experience in Google Cloud data services and modern big data ...
Pune, Maharashtra ₹1,500,000 - ₹3,500,000 (INR) per year Full time6 days ago
-
Introduction · In this role, you'll work in one of our IBM Consulting Client Innovation Centers (Delivery Centers), where we deliver deep technical and industry expertise to a wide range of public and private sector clients around the world. Our delivery centers offer our clients ...
India, Pune Full time6 days ago
- Work in company
Data Analyst-Data Management and Analytics-Data Ops/Data Analyst
Only for registered members
Data Analyst- Data Management and Analytics- Data Ops/Analyst with 5 - 9 years of experience in data analysis, decision-making, analytical skills and knowledge of Big Data frameworks like Hadoop, Hive and Spark. · Data mapping: Determine the data mapping required to join multiple ...
Pune, Maharashtra1 month ago
-
We are looking for a Big Data Engineer to design, develop and implement robust Big Data solutions using technologies such as Hadoop, Spark and NoSQL databases. The ideal candidate should have strong proficiency in Big Data technologies and frameworks. We offer competitive salary ...
Pune ₹900,000 - ₹2,800,000 (INR) per year Full time1 week ago
-
Introduction · In this role, you'll work in one of our IBM Consulting Client Innovation Centers (Delivery Centers), where we deliver deep technical and industry expertise to a wide range of public and private sector clients around the world. Our delivery centers offer our clients ...
Pune, India Full time2 days ago
-
We are looking for a self-motivated and enthusiastic Lead Cloud Data / Platform Engineer to join the Data Platforms and Engineering Services team. · This individual will be responsible to work with our Cloud Architects, Cloud infrastructure, Information Security, Technical Produc ...
Pune1 month ago
-
Introduction · In this role, you'll work in one of our IBM Consulting Client Innovation Centers (Delivery Centers), where we deliver deep technical and industry expertise to a wide range of public and private sector clients around the world. Our delivery centers offer our clients ...
India, Pune Full time2 days ago
-
5 Years of IT experience in SAS Development that uses advanced DATA step programming statements to solve complex problems. · SAS Developer that can write and interpret SAS SQL code. · SAS Developer that creates and use advance SAS macros · SAS Advanced Programming Professional Ce ...
Pune ₹800,000 - ₹2,500,000 (INR) per year Full time6 days ago
-
Designation: Data Engineer (Ab Initio) · Location: Pune, Bengaluru, Chennai · Experience: 4 years and above · Role Description · We are looking for · experienced Ab Initio professionals · to join a core data engineering team working on large-scale, business-critical data integrat ...
Pune, Maharashtra1 week ago
-
We are seeking a Mid-Level Full Stack Developer with 5-10 years of experience to join our dynamic team. · Experience: 5-10 years of professional experience as a Full Stack Developer. · Programming Languages: Strong proficiency in Python and Golang. · ...
Pune, Maharashtra2 weeks ago
-
Full Stack Developer (Mid-Level) · We are seeking a Mid-Level Full Stack Developer with 5-10 years of experience to join our dynamic team. The ideal candidate will be proficient in developing and maintaining both front-end and back-end applications, contributing to all phases of ...
Pune1 day ago
Hadoop Professional - Pune - confidential
Description
Key Responsibilities:
Education & Experience:
-
Big Data Engineer
Only for registered members Pune, Maharashtra
-
Data Analyst-Data Management and Analytics-Data Ops/Data Analyst
Full time Only for registered members Pune
-
Bigdata Analytics Architecture and Design
Only for registered members Pune
-
Spark-Scala -Professional
Only for registered members Pune
-
Data Engineer-Data Platforms-Aws
Only for registered members Pune
-
Data Engineer-Data Platforms-AWS
Only for registered members Pune
-
GCP Data Engineer
Only for registered members Pune, Maharashtra
-
Pyspark Architect
Full time Only for registered members Pune
-
Data Engineer-Data Platforms-AWS
Full time confidential- Pune, India
-
Data engineer GCP (Fulltime with fortune 500 company)
Full time Only for registered members Pune, Maharashtra
-
Data Engineer-Data Platforms-AWS
Full time confidential- India, Pune
-
Data Analyst-Data Management and Analytics-Data Ops/Data Analyst
Only for registered members Pune, Maharashtra
-
Big Data Engineer
Full time Only for registered members Pune
-
Data Engineer-Data Platforms-AWS
Full time IBM- Pune, India
-
Lead Data
Only for registered members Pune
-
Data Engineer-Data Platforms-AWS
Full time IBM- India, Pune
-
SAS Developer
Full time confidential- Pune
-
Data Engineer – Ab Initio
Only for registered members Pune, Maharashtra
-
PGT- Full Stack Developer- Mid Level
Only for registered members Pune, Maharashtra
-
PGT- Full Stack Developer- Mid Level
Only for registered members Pune