Databricks Pyspark - Hyderabad / Secunderabad, Telangana - confidential

Develop and optimize data processing jobs using PySpark to handle complex transformations and aggregations efficiently · Design and implement robust data pipelines on the AWS platform (Databricks exposure is a plus) · Utilize AWS services like EC2, S3 for scalable data processing ...

Total Yrs. of Experience 6+ Relevant Yrs. of experience 5+ Detailed JD (Roles and Responsibilities) 5+ years of hands-on Python development experience with excellent programming skills, 3+ years of experience with cloud-based platform, ideally Microsoft Azure, working experience ...

Roles and Responsibilities · 5+ years of experience on IT industry in Data Engineering & Data Analyst role. · 5 years of development experience using tool Databricks and PySpark, Python, SQL · Proficient in writing SQL queries including writing of windows functions · Good communi ...

Job Description: · Lead Data Engineer AWS Databricks Python Pyspark · Key Responsibilities: · A day in the life of an Infoscion · As part of the Infosys consulting team your primary role would be to lead the engagement effort of providing high quality and value adding consulting ...

Job Responsibilities: · Design, develop, and implement robust and scalable data pipelines using Azure Data Factory (ADF). · Efficiently extract, transform, and load (ETL) data from various disparate sources into Azure Data Lake Storage (ADLS). · Utilize Azure Databricks for advan ...

Skill Set: Azure Data Factory, Azure Databricks, Python/Pyspark · Joining time ( Notice period) Immediate joiners only · An Azure Data Factory, Azure Databricks, Python/PySpark Professional for Testing plays a vital role in ensuring the accuracy, performance, and reliability of d ...

We are seeking a PySpark Developer with IT experience. The ideal candidate will possess strong PySpark knowledge and hands-on experience in SQL, HDFS, Hive, Spark, PySpark, and Python. You will be instrumental in developing and optimizing data pipelines, working with large datas ...

Looking for 10+ Y / highly experienced and deeply hands-on Data Architect to lead the design, build, and optimization of our data platforms on AWS and Databricks. This role requires a strong blend of architectural vision and direct implementation expertise, ensuring scalable, sec ...

Looking for 10+ Y / highly experienced and deeply hands-on Data Architect to lead the design, build, and optimization of our data platforms on AWS and Databricks. This role requires a strong blend of architectural vision and direct implementation expertise, ensuring scalable, sec ...

Having 5 to 7 years experince in Python, Pyspark, Azure Databricks Development · Having good experience in Python coding · Good at Agile Process and Communication skills, Client Status Reporting and Client communication. Python, · Pyspark, · Azure Databricks Financial Services · ...

We are seeking an experienced and motivated Senior Data Engineer with strong expertise in Python, PySpark, Azure Databricks, and Azure Data Factory (ADF). The ideal candidate will design and implement scalable data pipelines and play a key role in enabling data-driven decision-ma ...

Design and implement comprehensive data solutions with Azure Databricks, focusing on scalability, performance, and cost savings. · Lead the development of data mesh, data lake, and data warehouse architectures customized for the manufacturing sector. · Work closely with cross-fun ...

Develop and optimize data processing jobs using PySpark for complex transformations and aggregations · Design and implement robust data pipelines on AWS, ensuring scalability and performance · Utilize AWS services like EC2 and S3 for data processing and storage solutions · Manage ...

Develop and optimize data processing jobs using PySpark to handle complex data transformations and aggregations efficiently. · Design and implement robust data pipelines on the AWS platform, ensuring scalability and efficiency (Databricks exposure will be an advantage) · Leverage ...

9+ years of industry experience including cloud technologies. · Very strong hands-on experience in Databricks with AWS cloud service in Data engineering/Data processing hands-on. · Hands on experience in AWS C loud-based development and integration · Proficiency in programming la ...

Relevant and Total years of experience Technology Lead Overall experience of 8 + years in IT delivery. Detailed job description - Skill Set:8+ years of total IT industry experience · 5+ years of relevant experience developing and implementing data pipelines using Python, Pyspark  ...

Folks with minimum 5+ year of experience in Data warehousing & Data engineering skill set. · Azure data factory & Databricks hands-on must, Snowflake good to have. · Very Strong SQL hands-on. · Energetic & collaborative. · Data Engineering Python/Pyspark. · Work with onsite folks ...

Job Description · Leading the data integration aspect of the project by designing and implementing robust ETL pipelines. · Creating PySpark scripts both generic templates and scripts tailored to specific project requirements — for data ingestion, transformation, and loading. · De ...

Job Responsibilities: · Design, develop, and maintain robust data pipelines and ETL processes using Azure Data Factory (ADF) and Azure Databricks. · Write proficient SQL queries to perform data mining and analysis, specifically focusing on Teradata as a primary RDBMS. · Develop c ...

Roles and Responsibilities · Minimum 6+ years of industry experience including cloud technologies. · Very strong hands-on experience in azure data bricks , azure SQLs development with Data Warehousing, Data modelling concept. · Good hands-on experience in Python/PySpark · Hands o ...