Hadoop Professional - Pune - confidential

    confidential
    confidential Pune

    6 days ago

    Full time
    Description

    Key Responsibilities:

    • Cluster Management: Design, implement, and manage large-scale Hadoop clusters to support business data requirements.
    • Configuration & Tuning: Configure and optimize Hadoop components, including HDFS, MapReduce, YARN, and Hive, for maximum performance and stability.
    • ETL Development: Develop and maintain custom applications and scripts to extract, transform, and load (ETL) data into the Hadoop ecosystem.
    • Integration: Integrate Hadoop with other Big Data tools and technologies to enable comprehensive data solutions.
    • Maintenance & Upgrades: Perform regular maintenance, patching, and version upgrades to ensure cluster reliability and high availability.
    • Monitoring & Troubleshooting: Continuously monitor Hadoop environments, identify potential issues, and resolve technical problems promptly.
    • Collaboration: Work closely with data scientists, analysts, and other teams to understand data processing needs and optimize Hadoop usage.
    • Documentation: Maintain detailed documentation of configurations, processes, and best practices.

    Education & Experience:

    • Bachelor's degree in Computer Science, Information Technology, or a related field.
    • Proven experience in Hadoop administration, implementation, and troubleshooting.
    • Experience with Big Data technologies such as Hive, Pig, Spark, or HBase is a plus.

  • Work in company

    Big Data Engineer

    Only for registered members

    This is a full-time hybrid role for a Big Data Engineer specializing in Hadoop and Google Cloud Platform (GCP). The role is based in Pune, with flexibility for part-time remote work. · ...

    Pune, Maharashtra

    1 month ago

  • Work in company

    Data Analyst-Data Management and Analytics-Data Ops/Data Analyst

    Only for registered members

    Data Analyst-Data Management and Analytics-Data Ops/Data Analyst · 5 - 9 years of professional experience as a Data Analyst with good decision-making, analytical and problem-solving skills. · Working knowledge / experience of Big Data frameworks like Hadoop, Hive and Spark. · ...

    Pune Full time

    3 weeks ago

  • Work in company

    Bigdata Analytics Architecture and Design

    Only for registered members

    · Job Description: · Project Role : Application Lead  Project Role Description : Lead the effort to design, build and configure applications, acting as the primary point of contact Must have Skills : Bigdata Analytics Architecture and Design  Good to Have Skills :  Scala Program ...

    Pune

    2 days ago

  • Work in company

    Spark-Scala -Professional

    Only for registered members

    We are looking for a skilled professional with expertise in Spark-Scala to join our team on a contract-to-hire basis. · Design, develop and implement scalable data processing pipelines using Spark-Scala. · Collaborate with cross-functional teams to identify and prioritize project ...

    Pune

    1 month ago

  • Work in company

    Data Engineer-Data Platforms-Aws

    Only for registered members

    As Data Engineer, you will develop, maintain, evaluate and test big data solutions. You will be involved in the development of data solutions using Spark Framework with Python or Scala on Hadoop and AWS Cloud Data Platform. · ...

    Pune

    2 weeks ago

  • Work in company

    Data Engineer-Data Platforms-AWS

    Only for registered members

    As Data Engineer you will develop and maintain big data solutions. You will be involved in the development of data solutions using Spark Framework with Python or Scala on Hadoop and AWS Cloud Data Platform. · ...

    Pune

    1 month ago

  • Work in company

    GCP Data Engineer

    Only for registered members

    +This is a full-time hybrid role based in Pune for a GCP Data Engineer (Hadoop Ecosystem). The role involves designing and implementing data pipelines, managing data platforms, and supporting Extract, Transform, Load (ETL) processes. · ...

    Pune, Maharashtra

    1 month ago

  • Work in company

    Pyspark Architect

    Only for registered members

    We are seeking a highly skilled and motivated PySpark Manager to lead our data engineering initiatives. · Lead and mentor a team of data engineers, ensuring high performance and professional growth. · Oversee project timelines, quality, and deliverables for multiple data initiati ...

    Pune Full time

    1 week ago

  • Work in company

    Data Engineer-Data Platforms-AWS

    confidential

    Introduction · In this role, you'll work in one of our IBM Consulting Client Innovation Centers (Delivery Centers), where we deliver deep technical and industry expertise to a wide range of public and private sector clients around the world. Our delivery centers offer our clients ...

    Pune, India Full time

    6 days ago

  • Work in company

    Data engineer GCP (Fulltime with fortune 500 company)

    Only for registered members

    Job Title: GCP Big Data Engineer · Location: Pune · Work Mode: Hybrid · Experience: 3 – 5 Years · Employment Type: Full-time · About the Role · We are looking for a skilled · GCP Big Data Engineer · with strong hands-on experience in Google Cloud data services and modern big data ...

    Pune, Maharashtra ₹1,500,000 - ₹3,500,000 (INR) per year Full time

    6 days ago

  • Work in company

    Data Engineer-Data Platforms-AWS

    confidential

    Introduction · In this role, you'll work in one of our IBM Consulting Client Innovation Centers (Delivery Centers), where we deliver deep technical and industry expertise to a wide range of public and private sector clients around the world. Our delivery centers offer our clients ...

    India, Pune Full time

    6 days ago

  • Work in company

    Data Analyst-Data Management and Analytics-Data Ops/Data Analyst

    Only for registered members

    Data Analyst- Data Management and Analytics- Data Ops/Analyst with 5 - 9 years of experience in data analysis, decision-making, analytical skills and knowledge of Big Data frameworks like Hadoop, Hive and Spark. · Data mapping: Determine the data mapping required to join multiple ...

    Pune, Maharashtra

    1 month ago

  • Work in company

    Big Data Engineer

    Only for registered members

    We are looking for a Big Data Engineer to design, develop and implement robust Big Data solutions using technologies such as Hadoop, Spark and NoSQL databases. The ideal candidate should have strong proficiency in Big Data technologies and frameworks. We offer competitive salary ...

    Pune ₹900,000 - ₹2,800,000 (INR) per year Full time

    1 week ago

  • Introduction · In this role, you'll work in one of our IBM Consulting Client Innovation Centers (Delivery Centers), where we deliver deep technical and industry expertise to a wide range of public and private sector clients around the world. Our delivery centers offer our clients ...

    Pune, India Full time

    2 days ago

  • Work in company

    Lead Data

    Only for registered members

    We are looking for a self-motivated and enthusiastic Lead Cloud Data / Platform Engineer to join the Data Platforms and Engineering Services team. · This individual will be responsible to work with our Cloud Architects, Cloud infrastructure, Information Security, Technical Produc ...

    Pune

    1 month ago

  • Introduction · In this role, you'll work in one of our IBM Consulting Client Innovation Centers (Delivery Centers), where we deliver deep technical and industry expertise to a wide range of public and private sector clients around the world. Our delivery centers offer our clients ...

    India, Pune Full time

    2 days ago

  • Work in company

    SAS Developer

    confidential

    5 Years of IT experience in SAS Development that uses advanced DATA step programming statements to solve complex problems. · SAS Developer that can write and interpret SAS SQL code. · SAS Developer that creates and use advance SAS macros · SAS Advanced Programming Professional Ce ...

    Pune ₹800,000 - ₹2,500,000 (INR) per year Full time

    6 days ago

  • Work in company

    Data Engineer – Ab Initio

    Only for registered members

    Designation: Data Engineer (Ab Initio) · Location: Pune, Bengaluru, Chennai · Experience: 4 years and above · Role Description · We are looking for · experienced Ab Initio professionals · to join a core data engineering team working on large-scale, business-critical data integrat ...

    Pune, Maharashtra

    1 week ago

  • Work in company

    PGT- Full Stack Developer- Mid Level

    Only for registered members

    We are seeking a Mid-Level Full Stack Developer with 5-10 years of experience to join our dynamic team. · Experience: 5-10 years of professional experience as a Full Stack Developer. · Programming Languages: Strong proficiency in Python and Golang. · ...

    Pune, Maharashtra

    2 weeks ago

  • Work in company

    PGT- Full Stack Developer- Mid Level

    Only for registered members

    Full Stack Developer (Mid-Level) · We are seeking a Mid-Level Full Stack Developer with 5-10 years of experience to join our dynamic team. The ideal candidate will be proficient in developing and maintaining both front-end and back-end applications, contributing to all phases of ...

    Pune

    1 day ago

Jobs
>
Pune