Power BI, SQL, Databricks - Hyderabad / Secunderabad, Telangana - confidential

Bachelors or masters degree in computer science, Engineering, or a related field. · 4 to 5 years of overall experience and 3+ years of experience designing and implementing data solutions on the Databricks platform. · Proficiency in programming languages such as Python, Scala, or ...

Roles and Responsibilities · 5+ years of experience on IT industry in Data Engineering & Data Analyst role. · 5 years of development experience using tool Databricks and PySpark, Python, SQL · Proficient in writing SQL queries including writing of windows functions · Good communi ...

Key Responsibilities: · Develop and optimize data pipelines using Spark and Databricks. · Write complex SQL queries to analyze and manipulate large datasets. · Implement Python-based scripts for data processing and automation. · Design and maintain ETL workflows for structured an ...

Looking for 10+ Y / highly experienced and deeply hands-on Data Architect to lead the design, build, and optimization of our data platforms on AWS and Databricks. This role requires a strong blend of architectural vision and direct implementation expertise, ensuring scalable, sec ...

Looking for 10+ Y / highly experienced and deeply hands-on Data Architect to lead the design, build, and optimization of our data platforms on AWS and Databricks. This role requires a strong blend of architectural vision and direct implementation expertise, ensuring scalable, sec ...

We are seeking an Azure Data Engineer with SQL Development expertise, including hands-on experience with SQL Queries and Stored Procedures. The ideal candidate will possess knowledge and hands-on experience with Cloud DB technologies such as Azure SQL, Azure Data Factory, Azure D ...

Azure services, Databricks, Core Java, REST webservices , event driven architecture,. · Oracle/SQL Server, GitHub, MQ , Kafka, Python. · Understanding of load balancer, Firewall, DNS, on-prem/cloud connectivity. · Mandatory Skills: · Azure Services, Databricks. · Good to Have Ski ...

5+ years of experience in Azure Data Factory, Snowflake, and Databricks · Understand business requirements and actively provide inputs from a data perspective · Understand the underlying data and data flow · Build simple to complex pipelines and dataflows · Work with other Azure ...

5+ years experience in Azure DataFactory, Snowflake, Databricks · Understand business requirement and actively provide inputs from Data perspective · Understand the underlying data and flow of data · Build simple to complex pipelines & dataflows · Work with other Azure stack modu ...

We are seeking a PySpark Developer with IT experience. The ideal candidate will possess strong PySpark knowledge and hands-on experience in SQL, HDFS, Hive, Spark, PySpark, and Python. You will be instrumental in developing and optimizing data pipelines, working with large datas ...

Key Responsibilities ETL Automation Frameworks: Design, develop, and maintain scalable ETL test automation frameworks to validate data pipelines across ingestion, transformation, and load layers. · Data Validation Automation: Automate validation of source-to-target mappings, busi ...

Develop and maintain a metadata driven generic ETL framework for automating ETL code · Design, build, and optimize ETL/ELT pipelines using Databricks (PySpark/SQL) on AWS . · Ingest data from a variety of structured and unstructured sources (APIs, RDBMS, flat files, streaming). · ...

Relevant Experience on Mandatory Skills 4-5 years Job Description Experienced, highly skilled at developer level. · Azure, Databricks, Core Java, REST webservices , Oracle/SQL Server, GitHub, MQ , Kafka, python. · Spring framework, Spring Boot. · Experience in writing complex SQL ...

Should have hands-on experience of working with ADLS, ADF and Azure SQL DW · Should have minimum 3 Years working experience of delivering Azure projects. · Must Have: · 3 to 8 years of experience working on design, develop, and deploy ETL processes on Databricks to support data i ...

Responsibilities: · Design, develop, and optimize scalable data pipelines using Databricks in AWS such as Glue, S3, Lambda, EMR, Databricks notebooks, workflows and jobs. · Building data lake in WS Databricks. · Build and maintain robust ETL/ELT workflows using Python and SQL to ...

Job description · Azure Data Factory: · - Develop Azure Data Factory Objects - ADF pipeline, configuration, parameters, variables, Integration services runtime · - Hands-on knowledge of ADF activities(such as Copy, SP, lkp etc) and DataFlows · - ADF data Ingestion and Integration ...

experience in designing large data distribution, integration with service-oriented architecture and/or data warehouse solutions, Data Lake solution using Azure Databricks with large and multi-format data · ability to translate working solution into implementable working package u ...

Design, develop, and maintain scalable ETL/ELT pipelines using Azure Databricks and Apache Spark. · Build data ingestion, transformation, and processing frameworks for structured and unstructured data. · Work with Azure services including ADLS Gen2, Azure Data Factory (ADF), Azur ...

Job Responsibilities: · Design, develop, and maintain robust data pipelines and ETL processes using Azure Data Factory (ADF) and Azure Databricks. · Write proficient SQL queries to perform data mining and analysis, specifically focusing on Teradata as a primary RDBMS. · Develop c ...

Key Responsibilities: · Data Pipeline Development & Optimization · Design, develop, and optimize data pipelines using Azure and Databricks. · Build and manage scalable ELT/ETL workflows with Databricks, Delta Lake, ADF, and other Azure services. · Optimize Spark, SQL, and Python ...