SQL, Python, Spark, Databricks - Hyderabad / Secunderabad, Telangana - Tavant

Roles & Responsibilities · Relevant required 4+ years of experience as lead developer with Datawarehouse, Big data and Hadoop implementation in Azure environment · Participate in design and implementation of the analytics architecture. · Experience in working on Hadoop Distributi ...

Relevant required 4+ years of experience as lead developer with Datawarehouse, Big data and Hadoop implementation in Azure environment · Participate in design and implementation of the analytics architecture. · Experience in working on Hadoop Distribution, good understanding of c ...

Relevant required 4+ years of experience as lead developer with Datawarehouse, Big data and Hadoop implementation in Azure environment · Participate in design and implementation of the analytics architecture. · Experience in working on Hadoop Distribution, good understanding of c ...

Looking for 10+ Y / highly experienced and deeply hands-on Data Architect to lead the design, build, and optimization of our data platforms on AWS and Databricks. This role requires a strong blend of architectural vision and direct implementation expertise, ensuring scalable, sec ...

Looking for 10+ Y / highly experienced and deeply hands-on Data Architect to lead the design, build, and optimization of our data platforms on AWS and Databricks. This role requires a strong blend of architectural vision and direct implementation expertise, ensuring scalable, sec ...

Design, develop, and maintain scalable ETL/ELT pipelines using Azure Databricks and Apache Spark. · Build data ingestion, transformation, and processing frameworks for structured and unstructured data. · Work with Azure services including ADLS Gen2, Azure Data Factory (ADF), Azur ...

Build & Optimize Pipelines: Develop high-throughput ETL workflows using PySpark on Databricks. · Data Architecture & Engineering: Work on distributed computing solutions, optimize Spark jobs, and build efficient data models. · Performance & Cost Optimization: Fine-tune Spark conf ...

Please Note - High NP will not considered (Only Immediate joiners) · Skilled and motivated Azure Databricks Data Engineer to join our dynamic team. The ideal candidate will have strong experience with · Python, Spark programming, and expertise inbuilding and optimizing data pipel ...

Key Responsibilities ETL Automation Frameworks: Design, develop, and maintain scalable ETL test automation frameworks to validate data pipelines across ingestion, transformation, and load layers. · Data Validation Automation: Automate validation of source-to-target mappings, busi ...

We are seeking a PySpark Developer with IT experience. The ideal candidate will possess strong PySpark knowledge and hands-on experience in SQL, HDFS, Hive, Spark, PySpark, and Python. You will be instrumental in developing and optimizing data pipelines, working with large datas ...

We are seeking a highly skilled Data Engineer with strong hands-on experience in Python, PySpark, Apache Spark, Kafka, and Databricks to design, build, and maintain scalable and high-performance data pipelines. The role focuses on developing robust batch and streaming data soluti ...

4+ years of relevant IT experience in the BI/DW domain with minimum 2 years of hands-on experience on Azure modern data platform that includes Data Factory, Databricks, Synapse (Azure SQL DW) and Azure Data Lake Meaningful experience of data analysis and transformation using Pyth ...

Responsibilities: · Design, develop, and optimize scalable data pipelines using Databricks in AWS such as Glue, S3, Lambda, EMR, Databricks notebooks, workflows and jobs. · Building data lake in WS Databricks. · Build and maintain robust ETL/ELT workflows using Python and SQL to ...

Design, build, and optimize scalable data pipelines and ETL workflows on Databricks. Architect and implement data lakehouse solutions integrating Databricks with Azure Data Lake, Azure Synapse, and other Azure services. · Ensure security, compliance, and governance of data platfo ...

Job description · Azure Data Factory: · - Develop Azure Data Factory Objects - ADF pipeline, configuration, parameters, variables, Integration services runtime · - Hands-on knowledge of ADF activities(such as Copy, SP, lkp etc) and DataFlows · - ADF data Ingestion and Integration ...

Develop and maintain a metadata driven generic ETL framework for automating ETL code · Design, build, and optimize ETL/ELT pipelines using Databricks (PySpark/SQL) on AWS . · Ingest data from a variety of structured and unstructured sources (APIs, RDBMS, flat files, streaming). · ...

Key Responsibilities: · Data Pipeline Development & Optimization · Design, develop, and optimize data pipelines using Azure and Databricks. · Build and manage scalable ELT/ETL workflows with Databricks, Delta Lake, ADF, and other Azure services. · Optimize Spark, SQL, and Python ...

Design and implement comprehensive data solutions with Azure Databricks, focusing on scalability, performance, and cost savings. · Lead the development of data mesh, data lake, and data warehouse architectures customized for the manufacturing sector. · Work closely with cross-fun ...

Key Responsibilities: · Lead the design, development, and optimization of scalable and secure data pipelines using AWS services such as Glue, S3, Lambda, EMR , and Databricks Notebooks , Jobs, and Workflows. · Oversee the development and maintenance of data lakes on AWS Databrick ...

Develop and optimize data processing jobs using PySpark to handle complex transformations and aggregations efficiently · Design and implement robust data pipelines on the AWS platform (Databricks exposure is a plus) · Utilize AWS services like EC2, S3 for scalable data processing ...