Data Engineer – PySpark - Chennai, Tamil Nadu
1 month ago
Job summary
Data Engineer – PySpark Design and implement data architecture,data strategy, and data roadmaps for large-scale systems.
Migrate traditional data warehousing to Big Data platforms.
Work on data modeling (Star/Snowflake schema) Ensure
data quality metadata management security archival Define
and execute cloud-native solutions Hands-on development using Python,
Pyspark Linux Git Collaborate with cross-functional teams in a matrix environment Handle multiple tasks independently with strong planning estimation execution Demonstrate strong problem-solving communication stakeholder management skills Mandatory Skills Pyspark Python Big Data Spark Hadoop Hive CI/CD for Data Engineering Good to Have Cloud migration experience
Job description
, consectetur adipiscing elit. Nullam tempor vestibulum ex, eget consequat quam pellentesque vel. Etiam congue sed elit nec elementum. Morbi diam metus, rutrum id eleifend ac, porta in lectus. Sed scelerisque a augue et ornare.
Donec lacinia nisi nec odio ultricies imperdiet.
Morbi a dolor dignissim, tristique enim et, semper lacus. Morbi laoreet sollicitudin justo eget eleifend. Donec felis augue, accumsan in dapibus a, mattis sed ligula.
Vestibulum at aliquet erat. Curabitur rhoncus urna vitae quam suscipit
, at pulvinar turpis lacinia. Mauris magna sem, dignissim finibus fermentum ac, placerat at ex. Pellentesque aliquet, lorem pulvinar mollis ornare, orci turpis fermentum urna, non ullamcorper ligula enim a ante. Duis dolor est, consectetur ut sapien lacinia, tempor condimentum purus.
Access all high-level positions and get the job of your dreams.
Similar jobs
We are looking for an experienced Data Engineer (PySpark) to design, build and manage large-scale data platforms and analytics solutions for complex enterprise systems. · Design and define data architecture · Implement end-to-end Data Management & Analytics solutions at scale · ...
1 month ago
Design and implement data architecture and strategy for large-scale systems. · ...
1 month ago
Design develop and maintain highly scalable optimized ETL pipelines using PySpark on the Cloudera Data Platform ensuring data integrity accuracy. · ...
2 weeks ago
Design develop and maintain ETL pipelines using PySpark on the Cloudera Data Platform ensuring data integrity and accuracy. · Ingestion processes from a variety of sources relational databases APIs file systems to the data lake or data warehouse on CDP. · ...
1 week ago
Data Engineer role requires leveraging latest AI & Analytics techniques to deliver value to clients by building world-class solutions using AI platforms & technologies. · ...
2 weeks ago
Greetings from Tata Consulting Services TCS is Hiring for Pyspark Data Engineer Experience:5+ years Location: Bangalore/Pune/Chennai/Gurugram · ...
1 day ago
Pyspark Data Engineer with 5+ years of experience required. Key skills include Pyspark, Python and data Spark. · Greetings from Tata Consulting Services. · TCS is Hiring for Pyspark Data Engineer. · ...
1 week ago
The Applications Development Programmer Analyst is an intermediate level position responsible for participation in the establishment and implementation of new or revised application systems and programs in coordination with the Technology team. · The overall objective of this rol ...
1 month ago
Job summaryThis role involves contributing to applications systems analysis and programming activities by identifying system enhancements , implementing solutions , solving complex issues using business processes and industry standards , conducting testing debugging writing basi ...
1 month ago
Utilize knowledge of applications development procedures and concepts, and basic knowledge of other technical areas to identify and define necessary system enhancements · Analyze information and make evaluative judgements to recommend solutions and improvements · Conduct testing ...
1 month ago
Working at Citi is far more than just a job. · A career with us means joining a team of more than 230,000 dedicated people from around the globe. At Citi, you'll have the opportunity to grow your career and make a real impact. · ...
1 month ago
Dun & Bradstreet - Generative AI Engineer - Python/PySpark
Only for registered members
Dun & Bradstreet Technology and Corporate Services India LLP is looking for candidates for the role of Senior Analyst to support the Data Science team. · Work across range of Analytical Solutions that includes Design Development Validation Calibration Documentation Implementation ...
1 week ago
Hiring | Data Engineer- Python Pyspark | Sr Analyst / Consultant |
Only for registered members
We are looking for a Data Engineer with expertise in Python Pyspark who will help us generate insights by leveraging AI and Analytics techniques. You will design scalable solutions using relational database management systems and ETL methods. · Analyze moderately complex problems ...
2 weeks ago
Develop and optimize large-scale data pipelines on GCP. · Write clean, testable code. · Troubleshoot data issues. · ...
1 month ago
+Job summary · Data Engineer role at the company involves designing, developing and maintaining scalable data pipelines that ensure high data quality and availability across the organization. · +ResponsibilitiesData Pipeline Development: Design, develop, and maintain highly scala ...
1 week ago
+We are seeking a highly skilled Data Engineer with deep expertise in PySpark and the Cloudera Data Platform (CDP) to join our data engineering team. · +- Design, develop, and maintain highly scalable and optimized ETL pipelines using PySpark on the Cloudera Data Platform, · - Im ...
1 month ago
AWS Data Engineer role involves working with AWS services including S3, Glue, DMS and Redshift. · ...
3 weeks ago
Teamware Solutions is seeking a skilled Databricks with Python developer to build optimize and manage our big data processing and analytics solutions. · ...
6 days ago
Data engineer with experience in PySpark and Cloudera Data Platform required for a position based in Chennai. · ...
1 month ago
We are seeking an experienced Azure Data Engineer with strong expertise in Python and PySpark to design, · develop,and optimize scalable data solutions on Microsoft Azure. · ...
6 days ago