- 10-12 years of experience in IT and data base/data warehouse domain
- Experience in writing sqls in Hive, Impala
- Exposure to scripting language like shell scripting, python is required.
- Strong SQL skills are essential; experience writing complex queries spanning multiple tables is required.
- Experience in AWS is plus.
- Working knowledge of performance tuning of database queries (understanding the inner working of the query optimizer, query plans, indexes, partitions etc.).
- Working knowledge of data modelling and dimensional modelling tools and techniques.
- Experience in data quality, data governance, DataOps and latest data management techniques a bonus.
- Must Have
- Big Data stacks: Hive/Impala/Hadoop/PySpark
- Advanced Python knowledge
- Advanced SQL knowledge
- Git hub/bit bucket
- Shell scripting
-
Senior Data Engineer · Position Summary · The Senior Data Engineer leads complex data engineering projects working on designing data architectures that align with business requirements This role focuses on optimizing data workflows managing data pipelines and ensuring the smooth ...
Chennai ₹600,000 - ₹2,200,000 (INR) per year Full time2 days ago
-
Seeking highly skilled and motivated Big Data Engineer with hands-on experience in Hadoop ecosystem, Apache Spark, and programming expertise in Python (PySpark), Scala, and Java. · ...
Chennai, Tamil Nadu1 month ago
-
Job description · Senior Data Engineer · Position Summary · The Senior Data Engineer leads complex data engineering projects working on designing data architectures that align with business requirements This role focuses on optimizing data workflows managing data pipelines and en ...
Chennai ₹600,000 - ₹2,200,000 (INR) per year Full time2 days ago
-
We are looking for a Developer who can work with Python and Spark in Chennai. · ...
Chennai, Tamil Nadu1 month ago
-
Responsibilities: · Skills Required: · Python, dataflow, Dataproc, GCP Cloud Run, DataForm, Agile Software Development, Big Query, TERRAFORM, Data Fusion, Cloud SQL, GCP, KAFKA · Bachelor s Degree 2+Years in GCP Services - Biq Query, Data Flow, Dataproc, DataPlex, DataFusion, Ter ...
Chennai ₹800,000 - ₹2,200,000 (INR) per year Full time6 days ago
-
We are seeking a highly skilled and motivated Big Data Engineer to join our data engineering team. · ...
Chennai1 month ago
-
Job Title: Python PySpark Developer · Experience Level · 5+ years of experience in Python development · Key Responsibilities · As a Python PySpark Developer, you will: · Feature Implementation: Translate requirements and implement product features using open-source technology sta ...
Chennai ₹800,000 - ₹2,200,000 (INR) per year Full time2 days ago
-
Job Title: - Pyspark with Python, AWS · Location: - Hyderabad · Minimum 7+ years of experience · Job Summary · Skill: IICS · Experiences: 6 to 13 years · Location: AIA Kochi · Has knowledge of Agile Methodology · Has understanding of Project Management · Has aware of ITIL process ...
Chennai6 days ago
-
Job Title: - Pyspark with Python, AWS · Location: - Hyderabad · Minimum 7+ years of experience · Job Summary · Skill: IICS · Experiences: 6 to 13 years · Location: AIA Kochi · Has knowledge of Agile Methodology · Has understanding of Project Management · Has aware of ITIL process ...
Chennai, Tamil Nadu6 days ago
-
Key Responsibilities: · Design, develop, and maintain ETL pipelines using Python, PySpark, and SQL on distributed data platforms. · Write clean, efficient, and scalable PySpark code for big data transformation and processing. · Develop reusable scripts and tools for data ingestio ...
Chennai Full time6 days ago
-
Data Engineer role requires leveraging latest AI & Analytics techniques to deliver value to clients by building world-class solutions using AI platforms & technologies. · ...
Chennai4 weeks ago
-
Title: Pyspark/Python ETL Developer with strong SQL Knowledge · Primary Responsibilities:- · Design, develop, and implement efficient and scalable data pipelines and ETL processes using Pyspark and Python. · Develop, optimize, and maintain complex SQL queries and stored procedure ...
Chennai Full time9 hours ago
-
We are hiring an experienced Senior Python / PySpark Developer to join our team for a strategic engagement with TCS. · Design, develop, and optimize scalable data pipelines using Python and PySpark · Work with large-scale datasets in distributed environments · Collaborate with da ...
Chennai, Tamil Nadu1 week ago
-
This is a python developer role with AI/ML experience. · Bachelor of Engineering · ...
Chennai, Tamil Nadu1 month ago
- Work in company
Dun & Bradstreet - Generative AI Engineer - Python/PySpark
Only for registered members
Dun & Bradstreet Technology and Corporate Services India LLP is looking for candidates for the role of Senior Analyst to support the Data Science team. · Work across range of Analytical Solutions that includes Design Development Validation Calibration Documentation Implementation ...
Chennai2 weeks ago
- Work in company
Hiring | Data Engineer- Python Pyspark | Sr Analyst / Consultant |
Only for registered members
We are looking for a Data Engineer with expertise in Python Pyspark who will help us generate insights by leveraging AI and Analytics techniques. You will design scalable solutions using relational database management systems and ETL methods. · Analyze moderately complex problems ...
Chennai3 weeks ago
-
Mandatory Skills : ETL, Python, SQL Desired Skills PySpark, Databricks, AWS, Terraform Develop and manage ETL processes using Python, PySpark, and SQL Work with Databricks for data processing Utilize AWS services like S3 CloudWatch IAM SNS and Lambda Familiarity with Terraform fo ...
Chennai, Mumbai, Pune4 weeks ago
-
We are seeking a skilled PySpark Developer with strong working experience in Python programming and a focus on PySpark. You must have hands-on experience with AWS Glue and PySpark, along with strong knowledge of popular libraries such as pandas and numpy. This role requires exper ...
Chennai ₹800,000 - ₹2,200,000 (INR) per year Full time2 days ago
-
Python/ Pyspark · Azure, Synapse, Data factory, data bricks · SQL Role & responsibilities · Preferred candidate profile · Python/ Pyspark · Azure, Synapse, Data factory, data bricks · SQL · ...
Chennai3 days ago
-
Specialization : · Good to have : Automation · Key Responsibilities : · ETL SDET - Python Pyspark, SQL, AWS · Qualifications : · AnyDegree · Professional Experience : · ETL SDET - Python Pyspark, SQL, AWS · ...
Chennai, Hyderabad, Noida3 days ago
Python Pyspark - Chennai - Virtusa
Description
-
Python Pyspark
Full time Virtusa- Chennai
-
Python Pyspark
Only for registered members Chennai, Tamil Nadu
-
Python Pyspark
Full time Virtusa- Chennai
-
Python Pyspark
Only for registered members Chennai, Tamil Nadu
-
Python, Pyspark Developer
Full time confidential- Chennai
-
Python Pyspark Professional
Only for registered members Chennai
-
Python Pyspark Developer
Full time Virtusa- Chennai
-
Pyspark with Python, AWS
Only for registered members Chennai
-
Pyspark with Python, AWS
Only for registered members Chennai, Tamil Nadu
-
Python, Pyspark, SQL Developer
Full time confidential- Chennai
-
Data Engineer- Python Pyspark
Only for registered members Chennai
-
Pyspark/Python ETL Developer
Full time Only for registered members Chennai
-
Senior Python,PySpark Developer
Only for registered members Chennai, Tamil Nadu
-
python with AI/ML,pyspark,AWS
Only for registered members Chennai, Tamil Nadu
-
Dun & Bradstreet - Generative AI Engineer - Python/PySpark
Only for registered members Chennai
-
Hiring | Data Engineer- Python Pyspark | Sr Analyst / Consultant |
Only for registered members Chennai
-
Aws Data Engineer
Only for registered members Chennai, Mumbai, Pune
-
PySpark Developer
Full time Apex 2000- Chennai
-
Azure Lead data engineer
Only for registered members Chennai
-
etl sdet
Only for registered members Chennai, Hyderabad, Noida