
prasanna kumar ganesan
Engineering / Architecture
About prasanna kumar ganesan:
I am a results-driven Data Engineer with over 9 years of experience, including 4 years specializing in Big Data and cloud-based data engineering and 5 years in database development. My expertise lies in leveraging Azure Databricks, Azure Data Factory, and Apache Spark to design and implement scalable, secure, and high-performance data pipelines.
Experience
Designed and maintained end-to-end ETL pipelines using
ADF to orchestrate data ingestion, transformation, and loading
across Azure SQL Database, Data Lake Storage.
➔ Optimized PySpark ETL jobs processing large datasets by
configuring Spark parameters, implementing effective data
partitioning, and using caching strategies, resulting in a 50%
improvement in job performance.
➔ Established multi-layered data lakehouse architecture
using Azure Databricks and Delta Lake, streamlining ETL
workflows and improving data reusability across teams.
➔ Implemented data partitioning and bucketing in PySpark for
optimal query performance on large datasets, improving
job execution speed and minimizing shuffle operations.
Education
2010 – 2014 B.E(ECE)
Professionals in the same Engineering / Architecture sector as prasanna kumar ganesan
Professionals from different sectors near Chennai, Chennai district
Other users who are called prasanna kumar
Jobs near Chennai, Chennai district
-
Job Title: [Senior Data Engineer] · Experience: [6 to 9 years] · Location: [Chennai/WFO-5 Days ] · About the Company: · Our client is a leading company in the digital advertising and media industry, specializing in OTT (Over-The-Top) and CTV (Connected TV) advertising solutions. ...
Chennai1 week ago
-
We are looking for a highly skilled and motivated Senior Data Engineer to join our clients team. You will play a key role in designing, implementing and optimizing data architectures and pipelines to support scalable data solutions for our business. · Design build and maintain ef ...
Tamil Nadu, Chennai, India1 month ago
-
As a Senior Developer specializing in Generative AI and Data Science you will play a pivotal role in developing innovative solutions that leverage cutting-edge technologies. · ...
Chennai1 month ago