beBee background
Professionals
>
Chennai
prasanna kumar ganesan

prasanna kumar ganesan

Senior Data Engineer | 9+ years Experience

Engineering / Architecture

Chennai, Chennai district

Social


About prasanna kumar ganesan:

I am a results-driven Data Engineer with over 9 years of experience, including 4 years specializing in Big Data and cloud-based data engineering and 5 years in database development. My expertise lies in leveraging Azure Databricks, Azure Data Factory, and Apache Spark to design and implement scalable, secure, and high-performance data pipelines.

Experience

Designed and maintained end-to-end ETL pipelines using

ADF to orchestrate data ingestion, transformation, and loading

across Azure SQL Database, Data Lake Storage.

➔ Optimized PySpark ETL jobs processing large datasets by

configuring Spark parameters, implementing effective data

partitioning, and using caching strategies, resulting in a 50%

improvement in job performance.

➔ Established multi-layered data lakehouse architecture

using Azure Databricks and Delta Lake, streamlining ETL

workflows and improving data reusability across teams.

➔ Implemented data partitioning and bucketing in PySpark for

optimal query performance on large datasets, improving

job execution speed and minimizing shuffle operations.

Education

2010 – 2014 B.E(ECE)

Professionals in the same Engineering / Architecture sector as prasanna kumar ganesan

Professionals from different sectors near Chennai, Chennai district

Other users who are called prasanna kumar

Jobs near Chennai, Chennai district

  • Work in company

    Senior Data Engineer

    Getinz Techno Services

    We are looking for a highly skilled and motivated Senior Data Engineer to join our clients team. You will play a key role in designing, implementing and optimizing data architectures and pipelines to support scalable data solutions for our business. · Design build and maintain ef ...

    Tamil Nadu, Chennai, India

    1 month ago

  • Work in company

    3876996-Senior Executive

    EXL

    Opportunity to learn and grow in a professional environment while supporting data-related tasks and projects. · ...

    Chennai

    1 month ago

  • Work in company

    Data Engineer

    MEEDEN LABS PRIVATE LIMITED

    Job Title: Data Engineer (Snowflake, Python & Databricks) · Exp : 5-9 Years · Work Location : Chennai/ Hyderabad · Work Mode : Hybrid · We are looking forward for immediate Joiners · Job Summary · We are seeking a highly skilled Data Engineer with strong experience in Snowflake, ...

    Chennai

    1 week ago