Databricks Automation - hyderabad - Xenon7

    Xenon7
    Xenon7 hyderabad

    11 hours ago

    Description
    About us:

    Where elite tech talent meets world-class opportunities

    At Xenon7, we work with leading enterprises and innovative startups on exciting, cutting-edge projects that leverage the latest technologies across various domains of IT including Data, Web, Infrastructure, AI, and many others. Our expertise in IT solutions development and on-demand resources allows us to partner with clients on transformative initiatives, driving innovation and business growth. Whether it's empowering global organizations or collaborating with trailblazing startups, we are committed to delivering advanced, impactful solutions that meet today's most complex challenges.

    We are building a community of top-tier experts and we're opening the doors to an exclusive group of exceptional AI & ML Professionals ready to solve real-world problems and shape the future of intelligent systems.

    Requirements

    Role Overview

    We are seeking a senior Databricks Automation & AI Platform Engineer with deep expertise in Python, Databricks platform components, and AI/MLOps/LLMOps workflows. The engineer will support the Next‑Gen Platform Integration team by building automation frameworks, enabling scalable deployment workflows, and integrating AI capabilities across Databricks environments.

    This role requires strong systems‑level Python knowledge, Databricks governance experience, and hands‑on AWS automation skills.

    Key Responsibilities

    Databricks Automation & Integration

    - Build automation workflows for MLOps, LLMOps, and application deployment within Databricks.
    - Enhance workspace onboarding automation including Unity Catalog, permissions, and environment setup.
    - Develop reusable modules for workspace provisioning, catalog configuration, model deployment, and governance workflows.
    - Integrate Mosaic AI components (Gateway, Model Serving, Agents) into platform automation.

    Platform Engineering & Deployment

    - Develop Python automation scripts for Databricks services including:

    - Unity Catalog
    - MLflow
    - Mosaic AI
    - Model Serving
    - Databricks Apps

    - Ensure consistency, reliability, and scalability across multi‑workspace environments.
    - Implement automated rollback strategies, fail‑fast mechanisms, and environment stability checks.

    AWS Integration & Automation

    - Build integrations using AWS Lambda, API Gateway, and Service Principal authentication.
    - Automate Databricks Job orchestration, monitoring, and deployment pipelines.
    - Implement secure, scalable automation bridging AWS and Databricks.

    Required Skills

    Technical Skills

    - Strong hands‑on Python experience including:

    - GIL behavior
    - Multiprocessing vs multithreading
    - Memory overhead trade‑offs
    - Data structure time complexities

    - Deep understanding of Databricks ecosystem:

    - Unity Catalog governance
    - Delta architecture (Bronze/Silver/Gold)
    - MLflow tracking & model lifecycle
    - Mosaic AI Gateway & LLMOps workflows
    - Model Serving & Databricks Apps

    - Experience with Docker image immutability, container state management, and environment reproducibility.

    Cloud & Automation Skills

    - AWS Lambda, API Gateway, IAM, and automation pipelines.
    - Service Principal‑based authentication for secure Databricks automation.
    - Experience with platform engineering, deployment automation, and production stability patterns.

    Ideal Candidate Profile

    - 6+ years of Python development and cloud automation experience.
    - Hands‑on Databricks platform engineering and governance expertise.
    - Strong understanding of MLOps/LLMOps and AI deployment workflows.
    - Experience working with platform, ML, and data engineering teams.
    - Immediate availability preferred.

  • Work in company Remote job

    Databricks Automation

    Only for registered members

    We are seeking a senior Databricks Automation & AI Platform Engineer with deep expertise in Python, Databricks platform components, and AI/MLOps/LLMOps workflows. · ...

    hyderabad

    1 month ago

  • Work in company

    Databricks Automation

    Only for registered members

    About us: · Where elite tech talent meets world-class opportunities · At Xenon7, we work with leading enterprises and innovative startups on exciting, cutting-edge projects that leverage the latest technologies across various domains of IT including Data, Web, Infrastructure, AI, ...

    hyderabad

    1 week ago

  • Work in company

    Databricks Automation

    Only for registered members

    We are seeking a senior Databricks Automation & AI Platform Engineer with deep expertise in Python, Databricks platform components, and AI/MLOps/LLMOps workflows. · Build automation workflows for MLOps, LLMOps, and application deployment within Databricks · Enhance workspace onbo ...

    Hyderabad

    1 month ago

  • Work in company

    Databricks Automation

    Only for registered members

    We are seeking a senior Databricks Automation & AI Platform Engineer with deep expertise in Python, · Databricks platform components, · and AI/MLOps/LLMOps workflows.We are building a community of top-tier experts. · ...

    Hyderabad Full time

    1 month ago

  • Work in company

    Azure Developer

    Only for registered members

    Years · INR (Lacs)/Yearly · Full-time · Full-time · Roles & Responsibility · Role: Azure DevOps/ETL · Location Should be PAN India · Exp:- 6+ Years · Budget:- 22 LPA - 25 LPA Max · JD:- DevOps Engineer - Azure Databricks ETL Pipeline Specialist · Building CI/CD pipleines for migr ...

    Hyderabad ₹800,000 - ₹2,200,000 (INR) per year

    1 week ago

  • Work in company

    Databricks with Pyspark

    Only for registered members

    Join our dynamic team as a Developer where you will leverage your expertise in Spark in Scala Delta Sharing and Databricks Unity Catalog Admin to drive impactful projects. · ...

    Hyderabad, Telangana ₹900,000 - ₹2,600,000 (INR) per year

    1 week ago

  • Work in company

    Azure Devops Engineer

    Only for registered members

    The role focuses on end-to-end CI/CD, deploying Databricks, managing Unity Catalogs, and access control. The new data platform will serve as a single source of truth for HNB data across clients and regions. · Develop and maintain CI/CD pipelines for Azure Databricks deployments ( ...

    Hyderabad

    3 weeks ago

  • Work in company

    Lead Data QA Automation Engineer

    Only for registered members

    We are looking for a Lead Data QA Automation Engineer to drive quality assurance for modern data pipelines and AI-driven analytics platforms with strong experience in Data Platforms, Automation Frameworks and Cloud Analytics. · Lead Data QA automation strategy for analytics platf ...

    Hyderabad, Telangana

    1 month ago

  • Work in company

    ETL Data Test Automation Engineer

    Only for registered members

    We are seeking experienced ETL Data Test Automation Engineers with Databricks expertise to validate complex cloud data pipelines. · Design/execute ETL/ELT test automation frameworks for cloud data pipelines · Validate Databricks pipelines (Notebooks, Jobs, Delta Lake, Unity Catal ...

    Hyderabad, Telangana

    1 month ago

  • Work in company

    Data Engineer

    Only for registered members

    Data Engineer role involves hands-on experience in data engineering activities such as data ingestion, transformation, cleansing quality validation building scalable ETL/ELT pipelines. · ...

    Hyderabad

    1 month ago

  • Work in company

    Databricks with Pyspark

    Only for registered members

    Databricks developer with experience in Spark and PySpark required for data processing and analysis. · ...

    Hyderabad, Telangana

    1 month ago

  • Work in company

    Python automation, DB Testing

    Only for registered members

    Detailed job description - Skill Set: · Test Automation Engineer having 5 to 7 years of experience in ETL testing and Python automation.Good at Functional Testing knowledge and hands on.Good at Agile Process and Communication skills, Client Status Reporting and Client communicat ...

    Hyderabad

    1 week ago

  • Work in company

    Developer

    Only for registered members

    We are seeking a Developer with 4 to 8 years of experience who is proficient in Spark in Scala Delta Sharing Databricks Unity Catalog Admin Databricks CLI Delta Live Pipelines Structured Streaming Risk Management Apache Airflow Amazon S3 Amazon Redshift Python Databricks SQL Data ...

    Hyderabad

    1 month ago

  • Work in company

    Databricks & PySpark Engineer

    Only for registered members

    We are looking for a skilled professional with 6-9 years of experience to join our team as a Databricks & PySpark expert in Pune. The ideal candidate will have a strong background in managing and optimizing Databricks clusters, pipelines and job orchestration. · ...

    Hyderabad

    2 weeks ago

  • Work in company

    Senior Manager

    Only for registered members

    +The Senior Manager, Platform Support Engineering leads a high performing team responsible for advanced technical support, platform reliability, and business intelligence (BI) enablement across cloud and enterprise environments. · ...

    Hyderabad

    1 month ago

  • Work in company

    DevOps Engineer

    Only for registered members

    We are seeking an experienced Data Engineer with DevOps expertise to design, implement, and manage CI/CD pipelines, cloud infrastructure, and data platform automation. · ...

    Hyderabad, Telangana

    2 weeks ago

  • Work in company

    Databricks SRE

    Only for registered members

    We are looking for a highly skilled Databricks SRE / Support Engineer to support AI Dojo, · a large-scale AI/ML upskilling platform developed by Optum / UnitedHealth Group (UHG). · This is an Individual Contributor (IC) role focused on ensuring the stability, · reliability, scala ...

    Hyderabad

    1 month ago

  • Work in company

    Databricks Administrator

    Only for registered members

    We're Hiring: Databricks Administrator (AWS/Azure – Multi-Cloud) · OwlSure, A Business Unit of ValueMomentum · Seniority Level: · Mid–Senior Level · Industry: · IT Services and IT Consulting · Job Function: · Cloud Platform Engineering | Data Platform Administration | Information ...

    Hyderabad, Telangana ₹900,000 - ₹2,200,000 (INR) per year

    5 hours ago

  • Work in company

    Databricks Architect

    Only for registered members

    Job Description   · We're seeking a hands-on Resident Solution Architect (Databricks)with deep technical expertise in building and optimizing Lakehouse-based data and AI solutions. This is a contract role based in Singapore, offering flexibility to work on-site with clients or re ...

    Hyderabad

    5 days ago

  • Work in company

    Cloud Architect

    Only for registered members

    Design and develop data solutions using Databricks and Azure services. · ...

    Hyderabad, Telangana

    1 month ago

  • Work in company Remote job

    Senior Databricks Data Engineer

    Only for registered members

    Senior Databricks Data Engineer with 5-6 years of experience in data engineering using I746 expertise. · Data governance · RBAC (Role-Based Access Control) · ...

    Hyderabad

    1 month ago

Jobs
>
Hyderabad