Jobs
>
Bengaluru

    Azure Databricks Engineer - Bengaluru, India - ARR Recruitment Solutions

    ARR Recruitment Solutions
    ARR Recruitment Solutions Bengaluru, India

    3 days ago

    Default job background
    Description
    Azure Databricks Engineer


    About the Role :

    • We are seeking a highly skilled Azure Databricks Engineer to join our team and play a vital role in developing and maintaining our big data processing pipelines.
    • This role is ideal for a candidate with extensive experience in Azure data services and a strong understanding of Apache Spark for largescale data processing.

    Responsibilities :

    • Design, develop, and implement efficient and scalable data processing pipelines using Apache Spark on Azure Databricks.
    • Collaborate with data engineers, data scientists, and other stakeholders to understand data requirements and translate them into technical solutions.
    • Leverage Azure Data Factory to orchestrate data movement and integration between various Azure data services (Data Lake, Synapse, SQL Database, etc. ).
    • Utilize SQL and Python/PySpark for data manipulation, transformation, and analysis.
    • Implement unit and integration tests to ensure the quality and reliability of data pipelines.
    • Configure and manage Azure Databricks clusters for optimal performance and resource utilization.
    • Integrate data pipelines with Azure DevOps for continuous integration and continuous delivery (CI/CD).
    • Monitor and troubleshoot data pipelines to identify and resolve issues proactively.
    • Stay uptodate with the latest advancements in Azure Databricks, Apache Spark, and related technologies.
    • Participate in code reviews and knowledge sharing sessions with the 510 years of experience in data engineering with a focus on big data processing.
    • Indepth knowledge of Azure data services, including Azure Databricks, Data Factory, Data Lake, and Synapse.
    • Proven experience in developing and deploying largescale data processing pipelines using Apache Spark.
    • Proficiency in SQL and Python/PySpark for data manipulation and analysis.
    • Experience with CI/CD methodologies and Azure DevOps is a plus.
    • Familiarity with data governance tools like Azure Purview or Collibra Unity Catalog (a plus).
    • Excellent problemsolving and analytical skills.
    • Strong communication and collaboration skills.
    • Ability to work independently and as part of a team.
    )
  • Hunarstreet Technologies

    Databricks Engineer

    3 days ago

    Hunarstreet Technologies Bengaluru, India

    Databricks Role Overview : · As a Data Engineer specializing in Databricks, you will play a pivotal role in collaborating with our clients to leverage the Databricks platform for extracting actionable insights from their data. From designing and implementing scalable data pipelin ...

  • Tredence Inc.

    Azure Databricks Engineer

    1 week ago

    Tredence Inc. Bengaluru, India

    Role: Senior Databricks Engineer / Databricks Technical Lead/ Data Architect · Experience: 3-12 years · Location: Bangalore, Chennai, Delhi, Pune, Kolkata · About Tredence: · Tredence focuses on last-mile delivery of powerful insights into profitable actions by uniting its str ...

  • Genpact

    Databricks platform engineer

    2 weeks ago

    Genpact Bengaluru, India

    With a startup spirit and 115,000+ curious and courageous minds, we have the expertise to go deep with the world's biggest brands—and we have fun doing it. We dream in digital, dare in reality, and reinvent the ways companies work to make an impact far bigger than just our bottom ...

  • RS Consultants

    ETL/Databricks Engineer

    2 days ago

    RS Consultants Bengaluru, India

    ETL (Databricks) · Job description : · Responsibilities : · - Build, document, test and launch new data extract, transform and load (ETL) processes for one or more core data sets. · - Collaborate with Business Intelligence team and other stakeholders for data requirements · - Co ...

  • Tekfortune IT India Pvt Ltd

    Databricks Administrator/Support Engineer

    1 week ago

    Tekfortune IT India Pvt Ltd Pune/Bangalore, India permanent

    Title : Databricks Engineer · Experience : 4 to 10 years · Work Location : Pune and Bangalore Location · Notice Period : Immediate to 45 Days · Job Description : · We are seeking a highly skilled and experienced Databricks Engineer to join our growing team and play a crucial rol ...

  • Ajmera Infotech Inc.

    Cloud Engineer – Azure Databricks

    1 week ago

    Ajmera Infotech Inc. Bengaluru, India

    Job Description · Position: Cloud Engineer – Azure Databricks · Experience: 5+ Years · Education: BTech/B. E - Computer Science, IT, Computer Engineering, MS in IT, MTech. MSc IT. · No of Positions: 5 · Mode: On-site · Location: Bengaluru, Ahmedabad, Hyderabad, Pune, Chenna ...

  • Ajmera Infotech Inc.

    Cloud Engineer – CI/CD pipeline + Azure Databricks

    1 week ago

    Ajmera Infotech Inc. Bengaluru, India

    Position: Cloud Engineer – CI/CD Pipeline + Azure Databricks · Experience: 5+ Years · Education: BTech/B. E - Computer Science, IT, Computer Engineering, MS in IT, MTech. MSc IT. · No of Positions: 5 · Mode: On-site · Location: Bengaluru, Ahmedabad, Hyderabad, Pune, Chennai a ...

  • Ajmera Infotech Inc.

    Cloud Engineer – CI/CD pipeline + Azure Databricks

    1 week ago

    Ajmera Infotech Inc. Bengaluru, India

    Job Description · Position: Cloud Engineer – CI/CD Pipeline + Azure Databricks · Experience: 5+ Years · Education: BTech/B. E - Computer Science, IT, Computer Engineering, MS in IT, MTech. MSc IT. · No of Positions: 5 · Mode: On-site · Location: Bengaluru, Ahmedabad, Hyderaba ...

  • Databricks

    Solutions Data Architect

    1 week ago

    Databricks Bengaluru, India

    As a **Solutions Architect** (Analytics, AI, Big Data, Public Cloud), you will guide the technical evaluation phase in a hands-on environment throughout the sales process. You will be a **technical advisor **internally to the sales team, and work with the product team as an advoc ...

  • Databricks

    Solutions Architect

    1 day ago

    Databricks Bengaluru, India

    As a **Solutions Architect** (Analytics, AI, Big Data, Public Cloud), you will guide the technical evaluation phase in a hands-on environment throughout the sales process. You will be a **technical advisor **internally to the sales team, and work with the product team as an advoc ...

  • Databricks

    Enterprise Solutions Architect

    1 week ago

    Databricks Bengaluru, India

    As a **Solutions Architect** (Analytics, AI, Big Data, Public Cloud), you will guide the technical evaluation phase in a hands-on environment throughout the sales process. You will be a technical advisor internally to the sales team, and work with the product team as an advocate ...

  • Databricks

    Solutions Architect

    3 days ago

    Databricks Bengaluru, India

    As a **Solutions Architect** (Analytics, AI, Big Data, Public Cloud), you will guide the technical evaluation phase in a hands-on environment throughout the sales process. You will be a **technical advisor **internally to the sales team, and work with the product team as an advoc ...

  • Databricks

    Architect : Big Data & Ai

    4 days ago

    Databricks Bengaluru, India

    As a **Solutions Architect** (Analytics, AI, Big Data, Public Cloud), you will guide the technical evaluation phase in a hands-on environment throughout the sales process. You will be a **technical advisor **internally to the sales team, and work with the product team as an advoc ...

  • Databricks

    Resident Solutions Architect

    1 week ago

    Databricks Bengaluru, India

    As a** Resident Solutions Architect** in our Professional Services team you will work with clients on short to medium term customer engagements on their big data challenges using the Databricks platform. You will provide data engineering, data science, and cloud technology projec ...

  • Databricks

    Solutions Architect

    2 days ago

    Databricks Bengaluru, India

    As a **Solutions Architect** (Analytics, AI, Big Data, Public Cloud), you will guide the technical evaluation phase in a hands-on environment throughout the sales process. You will be a **technical advisor **internally to the sales team, and work with the product team as an advoc ...

  • Databricks

    Principal Solutions Architect

    1 week ago

    Databricks Bengaluru, India

    As a Solutions Architect (Analytics, AI, Big Data, Public Cloud), you will guide the technical evaluation phase in a hands-on environment throughout the sales process. You will be a **technical advisor** internally to the sales team, and work with the product team as an advocate ...

  • PradeepIT Consulting Services

    Databricks (Remote)

    2 days ago

    PradeepIT Consulting Services Bengaluru, Karnataka, India

    **About the job Databricks (Remote)**: · Roles & responsibilities · - Developing Modern Data Warehouse solutions using Databricks and AWS/ Azure Stack · - Ability to provide solutions that are forward-thinking in data engineering and analytics space · - Collaborating with DW/BI l ...

  • RARR Technologies

    Azure Demand

    4 days ago

    RARR Technologies Bengaluru, India

    **Job Details - Azure Demand (ADF+Databricks+SQL)**: · **Job ID**: · - RARR Job 3391**Job Title**: · - Azure Demand (ADF+Databricks+SQL)**Job Type**: · - Permanent**Job Location**: · - Bangalore, Chennai, Hyderabad, Kolkata, Mumbai, New Delhi, Pune,**Total Experience**: · Years** ...

  • Infogain

    Architect

    1 week ago

    Infogain Bengaluru, India

    ROLES & RESPONSIBILITIES · - Primary skills: Azure Synapse, Synapse pipeline/ADF, ADLS, Databricks, Scala/Pyspark, Azure DB migration experience · - Secondary Skills - Hadoop, HIVE, Talend (Xperienxe in the past) · - Skills: Data Engineering, ADLS Gen 2, ADF, PYSpark, DataBricks ...

  • Databricks

    Growth Architect

    3 days ago

    Databricks Bengaluru, Karnataka, India

    CSQ325R3 · **Mission**: · At Databricks, we are on a mission to empower our customers to solve the world's toughest data problems by utilizing the Data Intelligence platform. As a Growth Architect, you will play a critical role in advising Customers in their onboarding journey. Y ...