Jobs
>
Pune

    Sr. Spark and Data Lake Administrator - Pune, India - Jade Global

    Jade Global
    Default job background
    Technology / Internet
    Description

    ob Description

    Responsibilities:

     Configure, fine-tune, and optimize Spark and YARN administration for high performance

    and resource efficiency.

     Setup, configuring and manage Data Lake Houses using Hudi and/or Delta Lake for

    efficient data storage and processing.

     Collaborate with cross-functional teams to design and maintain scalable and reliable

    data lake architectures.

     Monitor and troubleshoot Spark and Data Lake environments to ensure continuous

    operation and performance.

     Provide technical guidance, training and support to team members and stakeholders on

    Spark and Data Lake administration best practices.

    Requirements:

     Proven experience in configuring and tuning Spark and YARN administration in large-

    scale environments. Kubernetes experience a plus.

     Solid understanding of Data Lake architectures and Big Table technologies, data

    modeling, and management principles. Experience setting up, configuring and working

    with Hudi and/or Delta Lake.

     Experience in Python and Spark development is .

     Strong problem-solving skills and the ability to troubleshoot complex technical issues.

     Excellent communication and collaboration skills.


  • 157 CAREERS

    Azure DevOps

    1 week ago


    157 CAREERS Pune, India

    Azure Devops Mandate Relevant Experience : 5+years JD for Azure & DevOps engineer: · - Experience on CICD - Azure DevOps & GitLab · - Exp in Azure Cloud Platform foundational products/resources (AKS, Azure Databases, Virtual Networks, Function App, Webapp, etc) · - Experience in ...


  • Addepar Pune, Maharashtra, India

    **Who We Are** · Addepar is a global technology and data company that helps investment professionals provide the most informed, precise guidance for their clients. Hundreds of thousands of users have trusted Addepar to empower smarter investment decisions and better advice over t ...

  • Addepar

    Workplace Assistant

    3 days ago


    Addepar Pune, India

    **Who We Are** · Addepar's purpose is to maximize the positive impact of the world's capital. More than 850 of the world's leading financial services firms trust Addepar to unlock the power and possibility of informed, data-driven investing and advice. These family offices, wealt ...


  • Ensono Pune, Maharashtra, India

    **About us (Ensono)** · **Job Summary**: · A Snowflake Data Architect is a senior professional who will play a key role in designing and implementing data architectures using Snowflake's cloud data platform. Snowflake Data Architect has a crucial role in forming how data is organ ...

  • BirlaSoft

    Solution Architect

    1 week ago


    BirlaSoft Hinjawadi, Pune, Maharashtra, India

    Country/Region: IN- Requisition ID: 9348- Work Model: · - Position Type: · - Salary Range: · - Location: INDIA - PUNE - BIRLASOFT OFFICE - HINJAWADI**Title**:Solution Architect**: · - Description: · - **Azure Infrastructure Administrator (8+ Years)** · Total Experience: 8+ Years ...


  • SwiftWIN | A Concord Company Pune, India

    Key Responsibilities: · Design and Develop ADF Pipelines: Create efficient ADF pipelines to extract, transform, and load data between AS400 systems, Oracle databases, and Azure data services (e.g., Azure Synapse Analytics, Azure Data Lake Storage). · AS400 Data Integration: Utili ...

  • TMF Group

    Data Engineer

    3 days ago


    TMF Group Pune, India

    About TMF Group · TMF Group is a leading provider of critical administrative services, helping clients invest and operate safely around the world. Our 10,000 experts and 120 offices in 85 jurisdictions worldwide serve corporates, financial institutions, asset managers, private cl ...

  • LTIMindtree

    MongoDB

    1 week ago


    LTIMindtree Pune, India

    Experience - 6+ years · Locations - Pune / Mumbai /Chennai · Primary Skills- MongoDB · Notice Period - Immediate - 30 Days · Job Description- · Expertise in MongoDB Data Modeling/Design, SQL Development with Performance Tuning · • Expertise with MongoDB required. (required) · • E ...

  • LTIMindtree

    MongoDB

    1 day ago


    LTIMindtree Pune, India

    Experience - 6+ years · Locations - Pune / Mumbai /Chennai · Primary Skills- MongoDB · Notice Period - Immediate - 30 Days · Job Description- · Expertise in MongoDB Data Modeling/Design, SQL Development with Performance Tuning · • Expertise with MongoDB required. (required) · • E ...


  • Tech Mahindra Pune, India

    Role: Data Solution Architect · Experience: 12+ Years · Location: Pune, Bangalore · Notice Period: Immediate to 30 days max · interested people can share their resume to · TThe person appointed will be an integral member of the Architecture Team and will be responsible for the ...


  • Tech Mahindra Pune, India

    Role: Data Solution Architect · Location: Pune, Bangalore · Experience: 15+ years · Notice period: Immediate to 30 Days Max · Interested people can share their resumes to · Position Overview · The person appointed will be an integral member of the Architecture Team and will be r ...


  • Qualys Pune, India

    We are seeking a talented Lead Big Data Engineer to deliver roadmap features of Enterprise TruRisk Platform which would help customers to Measure, Communicate and Eliminate Cyber Risks. · Working with a team of engineers and architects, you will be responsible for prototyping, d ...


  • TELL Jobs Pune, India

    The person appointed will be an integral member of the Architecture Team and will be responsible for the design and implementation of the enterprise-wide data strategy, ensuring the strategy supports the current and future business needs. · The role will involve collaborating wit ...

  • Mindstix Software Labs

    SRE Engineer

    3 days ago


    Mindstix Software Labs Pune, India

    About Mindstix Software Labs · Mindstix accelerates digital transformation for the world's leading brands. We are a team of passionate innovators specialized in Cloud Engineering, Enterprise Mobility, Digital Experiences, and Data Science. · Our SRE experts deliver cloud strategy ...

  • TMF Group

    ETL Developer

    3 days ago


    TMF Group Pune, India

    About TMF Group · TMF Group is a leading global provider of high-value business services to clients operating and investing globally. We focus on providing specialized and business-critical financial and administrative services that enable our clients to operate their corporate s ...


  • TMF Group Pune, India

    We never ask for payment as part of our selection process, and we always contact candidates via our corporate accounts and platforms. If you are approached for payment, this is likely to be fraudulent. Please check to see whether the role you are interested in is posted here, on ...


  • addepar Pune, India

    Who We Are · Addepar is a global technology and data company that helps investment professionals provide the most informed, precise guidance for their clients. Hundreds of thousands of users have trusted Addepar to empower smarter investment decisions and better advice over the ...


  • BNY Mellon Pune, India

    Vice President, Back-End Engineer I · Bring your ideas. Make history. · BNY Mellon offers an exciting array of future-forward careers at the intersection of business, finance, and technology. We are one of the world's top asset management and banking firms that manages trillion ...