
prasanna kumar ganesan
Engineering / Architecture
About prasanna kumar ganesan:
I am a results-driven Data Engineer with over 9 years of experience, including 4 years specializing in Big Data and cloud-based data engineering and 5 years in database development. My expertise lies in leveraging Azure Databricks, Azure Data Factory, and Apache Spark to design and implement scalable, secure, and high-performance data pipelines.
Experience
Designed and maintained end-to-end ETL pipelines using
ADF to orchestrate data ingestion, transformation, and loading
across Azure SQL Database, Data Lake Storage.
➔ Optimized PySpark ETL jobs processing large datasets by
configuring Spark parameters, implementing effective data
partitioning, and using caching strategies, resulting in a 50%
improvement in job performance.
➔ Established multi-layered data lakehouse architecture
using Azure Databricks and Delta Lake, streamlining ETL
workflows and improving data reusability across teams.
➔ Implemented data partitioning and bucketing in PySpark for
optimal query performance on large datasets, improving
job execution speed and minimizing shuffle operations.
Education
2010 – 2014 B.E(ECE)
Professionals in the same Engineering / Architecture sector as prasanna kumar ganesan
Professionals from different sectors near Chennai, Chennai district
Other users who are called prasanna kumar
Jobs near Chennai, Chennai district
-
Snowflake developer with 5-9 years of experience in Snowflake data, Oracle developer, SQL, Data engineering, ETL. · Minimum 5 to 9 years of experience in working with Snowflake data, Oracle developer, SQL, Data engineering and ETL. · Certification in Project in Data Warehousing w ...
Chennai1 month ago
-
Our client is a large, globally established financial services organization with a long-standing history and a strong focus on innovation and digital transformation. · ...
Chennai1 month ago
-
Choosing Capgemini means choosing a company where you will be empowered to shape your career in the way you'd like, where you'll be supported and inspired by a collaborative community of colleagues around the world, and where you'll be able to reimagine what's possible. Join us a ...
Chennai, Tamil Nadu4 days ago