Azure Services, Databricks - Hyderabad / Secunderabad, Telangana - confidential

Looking for 10+ Y / highly experienced and deeply hands-on Data Architect to lead the design, build, and optimization of our data platforms on AWS and Databricks. This role requires a strong blend of architectural vision and direct implementation expertise, ensuring scalable, sec ...

Looking for 10+ Y / highly experienced and deeply hands-on Data Architect to lead the design, build, and optimization of our data platforms on AWS and Databricks. This role requires a strong blend of architectural vision and direct implementation expertise, ensuring scalable, sec ...

Job description · Azure Data Factory: · - Develop Azure Data Factory Objects - ADF pipeline, configuration, parameters, variables, Integration services runtime · - Hands-on knowledge of ADF activities(such as Copy, SP, lkp etc) and DataFlows · - ADF data Ingestion and Integration ...

Key Responsibilities: · Data Pipeline Development & Optimization · Design, develop, and optimize data pipelines using Azure and Databricks. · Build and manage scalable ELT/ETL workflows with Databricks, Delta Lake, ADF, and other Azure services. · Optimize Spark, SQL, and Python ...

Having 5 to 7 years experince in Python, Pyspark, Azure Databricks Development · Having good experience in Python coding · Good at Agile Process and Communication skills, Client Status Reporting and Client communication. Python, · Pyspark, · Azure Databricks Financial Services · ...

Should have hands-on experience of working with ADLS, ADF and Azure SQL DW · Should have minimum 3 Years working experience of delivering Azure projects. · Must Have: · 3 to 8 years of experience working on design, develop, and deploy ETL processes on Databricks to support data i ...

9+ years of industry experience including cloud technologies. · Very strong hands-on experience in Databricks with AWS cloud service in Data engineering/Data processing hands-on. · Hands on experience in AWS C loud-based development and integration · Proficiency in programming la ...

Develop and optimize data processing jobs using PySpark to handle complex transformations and aggregations efficiently · Design and implement robust data pipelines on the AWS platform (Databricks exposure is a plus) · Utilize AWS services like EC2, S3 for scalable data processing ...

experience in designing large data distribution, integration with service-oriented architecture and/or data warehouse solutions, Data Lake solution using Azure Databricks with large and multi-format data · ability to translate working solution into implementable working package u ...

Bachelors or masters degree in computer science, Engineering, or a related field. · 4 to 5 years of overall experience and 3+ years of experience designing and implementing data solutions on the Databricks platform. · Proficiency in programming languages such as Python, Scala, or ...

Develop and optimize data processing jobs using PySpark to handle complex data transformations and aggregations efficiently. · Design and implement robust data pipelines on the AWS platform, ensuring scalability and efficiency (Databricks exposure will be an advantage) · Leverage ...

Role Overview: · We are seeking street-smart and technically strong Senior Data Engineers / Leads who can take ownership of designing and developing cutting-edge data and AI platforms using Azure-native technologies and Databricks. You will play a critical role in building scalab ...

High proficiency and 8 10 years of experience in designing/developing data analytics and data warehouse solutions with Azure Data Factory (ADF) and Azure Data Bricks. · Experience in designing large data distribution, integration with service-oriented architecture and/or data war ...

What You Will Do: · Following are high level responsibilities that you will play but not limited to: · Lead the design, development, and implementation of modern data pipelines, data models, and ETL/ELT processes. · Architect and optimize data lake and warehouse solutions using M ...

Develop and optimize data processing jobs using PySpark for complex transformations and aggregations · Design and implement robust data pipelines on AWS, ensuring scalability and performance · Utilize AWS services like EC2 and S3 for data processing and storage solutions · Manage ...

We are seeking an experienced and motivated Senior Data Engineer with strong expertise in Python, PySpark, Azure Databricks, and Azure Data Factory (ADF). The ideal candidate will design and implement scalable data pipelines and play a key role in enabling data-driven decision-ma ...

Develop and optimize data processing jobs using PySpark to handle complex data transformations and aggregations efficiently. · Design and implement robust data pipelines on the AWS platform, ensuring scalability and efficiency. · Leverage AWS services such as EC2, S3 for comprehe ...

No of years' experience 5+ Years Detailed job description Skill Set:. · Expertise in database testing and should be able to write complex SQL queries. · Proficient in any 1 programming language (Python, Java, Scala etc). · Hands-on experience in system, integration and regression ...

Ready to shape the future of work · At Genpact, we don't just adapt to change-we drive it. AI and digital innovation are redefining industries, and we're leading the charge. Genpact's AI Gigafactory, our industry-first accelerator, is an example of how we're scaling advanced tech ...

Role Responsibilities: · Build scalable data pipelines and applications from scratch on AWS · Design and manage data ingestion processes and workflows · Collaborate with functional and data science teams to deliver data solutions · Optimize data storage and organization using HDF ...