Jobs
>
Bengaluru

    Lead Azure Databricks Engineer - Bangalore, India - VIDPRO CONSULTANCY SERVICES

    Default job background
    Technology / Internet
    Description

    Primary Roles and Responsibilities :

    • Developing Modern Data Warehouse solutions using Databricks and AWS/ AzureStack.
    • Ability to provide solutions that are forwardthinking in data engineering and analytics space.
    • Collaborate with DW/BI leads to understand new ETL pipeline development requirements.
    • Triage issues to find gaps in existing pipelines and fix the issues.
    • Work with business to understand the need in reporting layer and develop data model to fulfill reporting needs.
    • Help joiner team members to resolve issues and technical challenges.
    • Drive technical discussion with client architect and team members.
    • Orchestrate the data pipelines in scheduler via AirflowSkills.

    Qualifications :

    • Bachelor's and/or master's degree in computer science or equivalent experience.
    • We are looking for 5+ to 15 Years of experience as Azure Data Engineer.

    Mandatory skills :
    Azure Databricks, Azure Data Factory, Azure Data Lake, Python, Pyspark, SQL.

    • Deep understanding of Star and Snowflake dimensional modeling.
    • Strong knowledge of Data Management principles.
    • Good understanding of Databricks Data & AI platform and Databricks DeltaLake Architecture.
    • Should have handson experience in SQL, Python And Spark (PySpark).
    • Candidate must have experience in AWS/ Azure Stack.
    • Desirable to have ETL with batch and streaming(Kinesis).
    • Experience in building ETL / data warehouse transformation processes.
    • Experience with Apache Kafka for use with streaming data / eventbased data.
    • Experience with other Open-Source big data products Hadoop (incl. Hive, Pig, Impala).
    • Experience with Open Source nonrelational / NoSQL data repositories (incl. MongoDB, Cassandra, Neo4J).
    • Experience working with structured and unstructured data including imaging & geospatial data.
    • Experience working in a Dev/Ops environment with tools such as Terraform,CircleCI, GIT.
    • Proficiency in RDBMS, complex SQL, PL/SQL,Unix Shell Scripting, performance tuning and troubleshoot.
    • Databricks Certified Data Engineer Associate / Professional Certification (Desirable).
    • Comfortable working in a dynamic, fastpaced, innovative environment with several ongoing concurrent projects.
    • Should have experience working in Agile methodology.
    • Strong verbal and written communication skills.
    • Strong analytical and problemsolving skills with a high attention to detail.

    Mandatory Skills:
    Python/ PySpark / Spark with Azure/ AWS Databricks.
    )

  • Hunarstreet Technologies

    Databricks Engineer

    20 hours ago


    Hunarstreet Technologies Bangalore, India

    Databricks Role Overview : · As a Data Engineer specializing in Databricks, you will play a pivotal role in collaborating with our clients to leverage the Databricks platform for extracting actionable insights from their data. From designing and implementing scalable data pipeli ...

  • Unilode

    Databricks Engineer

    20 hours ago


    Unilode bangalore, India

    Databricks Engineer · Position Overview · The job purpose of a Databricks Engineer is to be a key contributor in ensuring that an organization's data is processed efficiently, securely, and accurately using the Databricks platform. They support data analytics, provide technic ...

  • Magna

    DataBricks Engineer

    20 hours ago


    Magna bangalore, India

    About us · We see a future where everyone can live and move without limitations. That's why we are developing technologies, systems and concepts that make vehicles safer and cleaner, while serving our communities, the planet and, above all, people. · Forward. For all. · Group ...


  • Genpact Bengaluru, India

    With a startup spirit and 115,000+ curious and courageous minds, we have the expertise to go deep with the world's biggest brands—and we have fun doing it. We dream in digital, dare in reality, and reinvent the ways companies work to make an impact far bigger than just our bottom ...


  • Tredence Inc. Bengaluru, India

    Role: Senior Databricks Engineer / Databricks Technical Lead/ Data Architect · Experience: 3-12 years · Location: Bangalore, Chennai, Delhi, Pune, Kolkata · About Tredence: · Tredence focuses on last-mile delivery of powerful insights into profitable actions by uniting its streng ...


  • ResourceTree Global Services Bangalore, India

    Job Title : Senior Databricks Data Engineer · Skillset : Databricks, Datalake Architecture, Azure · Experience : 6 - 8 years · Location : Chennai · Job Summary : · We are seeking an experienced Senior Databricks Data Engineer with a very good understanding of Databricks, Lakeh ...


  • RS Consultants bangalore, India

    ETL (Databricks) · Job description : · Responsibilities : · - Build, document, test and launch new data extract, transform and load (ETL) processes for one or more core data sets. · - Collaborate with Business Intelligence team and other stakeholders for data requirements · - Co ...


  • ARR Recruitment Solutions bangalore, India

    Azure Databricks Engineer · About the Role : · - We are seeking a highly skilled Azure Databricks Engineer to join our team and play a vital role in developing and maintaining our big data processing pipelines. · - This role is ideal for a candidate with extensive experience in ...


  • Tredence Inc. Bengaluru, India

    Role: Senior Databricks Engineer / Databricks Technical Lead/ Data ArchitectExperience: 3-12 yearsLocation: Bangalore, Chennai, Delhi, Pune, KolkataAbout Tredence:Tredence focuses on last-mile delivery of powerful insights into profitable actions by uniting its strengths in busin ...


  • codersbrain Bangalore, India

    We have an opening for Azure Databricks. · Experience : 6 to 12 yrs · Location : Bangalore · Interview : Face to face interview on 2nd and 3rd March · Mandatory Skills : · - Azure Data Factory · - Python · - Pyspark · - SQL · - Azure Data Lake · Job Description : · - Around 7 to ...


  • Tekfortune IT India Pvt Ltd Pune/Bangalore, India permanent

    Title : Databricks Engineer · Experience : 4 to 10 years · Work Location : Pune and Bangalore Location · Notice Period : Immediate to 45 Days · Job Description : · We are seeking a highly skilled and experienced Databricks Engineer to join our growing team and play a cruci ...


  • ResourceTree Global Services Bangalore, India

    Resource Tree Global Services Pvt Ltd is hiring Senior Databricks Data Engineer for one of its leading client in Content & Data Analytics. Below are the details . · Job Title : Senior Databricks Data Engineer · Skills Required : Azure, Databricks, Datalake, Python/Scala/Java, Da ...


  • Ajmera Infotech Inc. Bengaluru, India

    Job Description · Position: Cloud Engineer – Azure Databricks · Experience: 5+ Years · Education: BTech/B. E - Computer Science, IT, Computer Engineering, MS in IT, MTech. MSc IT. · No of Positions: 5 · Mode: On-site · Location: Bengaluru, Ahmedabad, Hyderabad, Pune, Chenna ...


  • MNC bangalore, India

    Hi AllUrgent hiring for Azure Data Architect/ Data Engineer with Databricks with MNC for Pan India : · Experience: YrsJob Title Azure Data engineer with DatabricksRelevant Experience &Experience Required(in Yrs) 6+ yearsKey words to search inresume Azure Data Services, and Data B ...


  • Ajmera Infotech Inc. Bengaluru, India

    Job Description · Position: Cloud Engineer – CI/CD Pipeline + Azure Databricks · Experience: 5+ Years · Education: BTech/B. E - Computer Science, IT, Computer Engineering, MS in IT, MTech. MSc IT. · No of Positions: 5 · Mode: On-site · Location: Bengaluru, Ahmedabad, Hyderaba ...


  • Ajmera Infotech Inc. Bengaluru, India

    Position: Cloud Engineer – CI/CD Pipeline + Azure Databricks · Experience: 5+ Years · Education: BTech/B. E - Computer Science, IT, Computer Engineering, MS in IT, MTech. MSc IT. · No of Positions: 5 · Mode: On-site · Location: Bengaluru, Ahmedabad, Hyderabad, Pune, Chennai a ...


  • Databricks Bengaluru, India

    As a **Solutions Architect** (Analytics, AI, Big Data, Public Cloud), you will guide the technical evaluation phase in a hands-on environment throughout the sales process. You will be a **technical advisor **internally to the sales team, and work with the product team as an advoc ...

  • Databricks

    Solutions Architect

    3 days ago


    Databricks Bengaluru, India

    As a **Solutions Architect** (Analytics, AI, Big Data, Public Cloud), you will guide the technical evaluation phase in a hands-on environment throughout the sales process. You will be a **technical advisor **internally to the sales team, and work with the product team as an advoc ...


  • Databricks Bengaluru, India

    As a **Solutions Architect** (Analytics, AI, Big Data, Public Cloud), you will guide the technical evaluation phase in a hands-on environment throughout the sales process. You will be a technical advisor internally to the sales team, and work with the product team as an advocate ...


  • Databricks Bengaluru, India

    As a **Solutions Architect** (Analytics, AI, Big Data, Public Cloud), you will guide the technical evaluation phase in a hands-on environment throughout the sales process. You will be a **technical advisor **internally to the sales team, and work with the product team as an advoc ...