- Developing Modern Data Warehouse solutions using Databricks and AWS/ AzureStack.
- Ability to provide solutions that are forwardthinking in data engineering and analytics space.
- Collaborate with DW/BI leads to understand new ETL pipeline development requirements.
- Triage issues to find gaps in existing pipelines and fix the issues.
- Work with business to understand the need in reporting layer and develop data model to fulfill reporting needs.
- Help joiner team members to resolve issues and technical challenges.
- Drive technical discussion with client architect and team members.
- Orchestrate the data pipelines in scheduler via AirflowSkills.
- Bachelor's and/or master's degree in computer science or equivalent experience.
- We are looking for 5+ to 15 Years of experience as Azure Data Engineer.
- Deep understanding of Star and Snowflake dimensional modeling.
- Strong knowledge of Data Management principles.
- Good understanding of Databricks Data & AI platform and Databricks DeltaLake Architecture.
- Should have handson experience in SQL, Python And Spark (PySpark).
- Candidate must have experience in AWS/ Azure Stack.
- Desirable to have ETL with batch and streaming(Kinesis).
- Experience in building ETL / data warehouse transformation processes.
- Experience with Apache Kafka for use with streaming data / eventbased data.
- Experience with other Open-Source big data products Hadoop (incl. Hive, Pig, Impala).
- Experience with Open Source nonrelational / NoSQL data repositories (incl. MongoDB, Cassandra, Neo4J).
- Experience working with structured and unstructured data including imaging & geospatial data.
- Experience working in a Dev/Ops environment with tools such as Terraform,CircleCI, GIT.
- Proficiency in RDBMS, complex SQL, PL/SQL,Unix Shell Scripting, performance tuning and troubleshoot.
- Databricks Certified Data Engineer Associate / Professional Certification (Desirable).
- Comfortable working in a dynamic, fastpaced, innovative environment with several ongoing concurrent projects.
- Should have experience working in Agile methodology.
- Strong verbal and written communication skills.
- Strong analytical and problemsolving skills with a high attention to detail.
-
Databricks Engineer
20 hours ago
Hunarstreet Technologies Bangalore, IndiaDatabricks Role Overview : · As a Data Engineer specializing in Databricks, you will play a pivotal role in collaborating with our clients to leverage the Databricks platform for extracting actionable insights from their data. From designing and implementing scalable data pipeli ...
-
Databricks Engineer
20 hours ago
Unilode bangalore, IndiaDatabricks Engineer · Position Overview · The job purpose of a Databricks Engineer is to be a key contributor in ensuring that an organization's data is processed efficiently, securely, and accurately using the Databricks platform. They support data analytics, provide technic ...
-
DataBricks Engineer
20 hours ago
Magna bangalore, IndiaAbout us · We see a future where everyone can live and move without limitations. That's why we are developing technologies, systems and concepts that make vehicles safer and cleaner, while serving our communities, the planet and, above all, people. · Forward. For all. · Group ...
-
Databricks platform engineer
2 weeks ago
Genpact Bengaluru, IndiaWith a startup spirit and 115,000+ curious and courageous minds, we have the expertise to go deep with the world's biggest brands—and we have fun doing it. We dream in digital, dare in reality, and reinvent the ways companies work to make an impact far bigger than just our bottom ...
-
Azure Databricks Engineer
15 hours ago
Tredence Inc. Bengaluru, IndiaRole: Senior Databricks Engineer / Databricks Technical Lead/ Data Architect · Experience: 3-12 years · Location: Bangalore, Chennai, Delhi, Pune, Kolkata · About Tredence: · Tredence focuses on last-mile delivery of powerful insights into profitable actions by uniting its streng ...
-
Azure Databricks Engineer
20 hours ago
ResourceTree Global Services Bangalore, IndiaJob Title : Senior Databricks Data Engineer · Skillset : Databricks, Datalake Architecture, Azure · Experience : 6 - 8 years · Location : Chennai · Job Summary : · We are seeking an experienced Senior Databricks Data Engineer with a very good understanding of Databricks, Lakeh ...
-
ETL/Databricks Engineer
20 hours ago
RS Consultants bangalore, IndiaETL (Databricks) · Job description : · Responsibilities : · - Build, document, test and launch new data extract, transform and load (ETL) processes for one or more core data sets. · - Collaborate with Business Intelligence team and other stakeholders for data requirements · - Co ...
-
Azure Databricks Engineer
20 hours ago
ARR Recruitment Solutions bangalore, IndiaAzure Databricks Engineer · About the Role : · - We are seeking a highly skilled Azure Databricks Engineer to join our team and play a vital role in developing and maintaining our big data processing pipelines. · - This role is ideal for a candidate with extensive experience in ...
-
Azure Databricks Engineer
15 hours ago
Tredence Inc. Bengaluru, IndiaRole: Senior Databricks Engineer / Databricks Technical Lead/ Data ArchitectExperience: 3-12 yearsLocation: Bangalore, Chennai, Delhi, Pune, KolkataAbout Tredence:Tredence focuses on last-mile delivery of powerful insights into profitable actions by uniting its strengths in busin ...
-
Azure Databricks Engineer
20 hours ago
codersbrain Bangalore, IndiaWe have an opening for Azure Databricks. · Experience : 6 to 12 yrs · Location : Bangalore · Interview : Face to face interview on 2nd and 3rd March · Mandatory Skills : · - Azure Data Factory · - Python · - Pyspark · - SQL · - Azure Data Lake · Job Description : · - Around 7 to ...
-
Databricks Administrator/Support Engineer
20 hours ago
Tekfortune IT India Pvt Ltd Pune/Bangalore, India permanentTitle : Databricks Engineer · Experience : 4 to 10 years · Work Location : Pune and Bangalore Location · Notice Period : Immediate to 45 Days · Job Description : · We are seeking a highly skilled and experienced Databricks Engineer to join our growing team and play a cruci ...
-
Lead Azure Databricks Engineer
20 hours ago
ResourceTree Global Services Bangalore, IndiaResource Tree Global Services Pvt Ltd is hiring Senior Databricks Data Engineer for one of its leading client in Content & Data Analytics. Below are the details . · Job Title : Senior Databricks Data Engineer · Skills Required : Azure, Databricks, Datalake, Python/Scala/Java, Da ...
-
Cloud Engineer – Azure Databricks
1 week ago
Ajmera Infotech Inc. Bengaluru, IndiaJob Description · Position: Cloud Engineer – Azure Databricks · Experience: 5+ Years · Education: BTech/B. E - Computer Science, IT, Computer Engineering, MS in IT, MTech. MSc IT. · No of Positions: 5 · Mode: On-site · Location: Bengaluru, Ahmedabad, Hyderabad, Pune, Chenna ...
-
Azure Data Architect/ Data Engineer with Databricks
20 hours ago
MNC bangalore, IndiaHi AllUrgent hiring for Azure Data Architect/ Data Engineer with Databricks with MNC for Pan India : · Experience: YrsJob Title Azure Data engineer with DatabricksRelevant Experience &Experience Required(in Yrs) 6+ yearsKey words to search inresume Azure Data Services, and Data B ...
-
Ajmera Infotech Inc. Bengaluru, IndiaJob Description · Position: Cloud Engineer – CI/CD Pipeline + Azure Databricks · Experience: 5+ Years · Education: BTech/B. E - Computer Science, IT, Computer Engineering, MS in IT, MTech. MSc IT. · No of Positions: 5 · Mode: On-site · Location: Bengaluru, Ahmedabad, Hyderaba ...
-
Ajmera Infotech Inc. Bengaluru, IndiaPosition: Cloud Engineer – CI/CD Pipeline + Azure Databricks · Experience: 5+ Years · Education: BTech/B. E - Computer Science, IT, Computer Engineering, MS in IT, MTech. MSc IT. · No of Positions: 5 · Mode: On-site · Location: Bengaluru, Ahmedabad, Hyderabad, Pune, Chennai a ...
-
Solutions Data Architect
1 week ago
Databricks Bengaluru, IndiaAs a **Solutions Architect** (Analytics, AI, Big Data, Public Cloud), you will guide the technical evaluation phase in a hands-on environment throughout the sales process. You will be a **technical advisor **internally to the sales team, and work with the product team as an advoc ...
-
Solutions Architect
3 days ago
Databricks Bengaluru, IndiaAs a **Solutions Architect** (Analytics, AI, Big Data, Public Cloud), you will guide the technical evaluation phase in a hands-on environment throughout the sales process. You will be a **technical advisor **internally to the sales team, and work with the product team as an advoc ...
-
Enterprise Solutions Architect
1 week ago
Databricks Bengaluru, IndiaAs a **Solutions Architect** (Analytics, AI, Big Data, Public Cloud), you will guide the technical evaluation phase in a hands-on environment throughout the sales process. You will be a technical advisor internally to the sales team, and work with the product team as an advocate ...
-
Architect : Big Data & Ai
6 days ago
Databricks Bengaluru, IndiaAs a **Solutions Architect** (Analytics, AI, Big Data, Public Cloud), you will guide the technical evaluation phase in a hands-on environment throughout the sales process. You will be a **technical advisor **internally to the sales team, and work with the product team as an advoc ...
Lead Azure Databricks Engineer - Bangalore, India - VIDPRO CONSULTANCY SERVICES
Description
Primary Roles and Responsibilities :
Qualifications :
Mandatory skills :
Azure Databricks, Azure Data Factory, Azure Data Lake, Python, Pyspark, SQL.
Mandatory Skills:
Python/ PySpark / Spark with Azure/ AWS Databricks.
)