beBee background
Professionals
>
Pune
Piyush Joshi

Piyush Joshi

Azure Data Engineer

Technology / Internet

Pune, Pune

Social

About Piyush Joshi:

I am an azure data engineer with 3.3 years of experience in building and optimizing adf data pipelines and developing Py spark and SQL code for data transformation.Some of my skills are ADF,synapse analytics,azure databricks,azure function app,kafka,azure storage.

Experience

As a junior Azure Data Engineer, I supported development and production bug-fixing activities for the 'Ingestion' framework, ensuring robust and reliable data pipeline operations. I contributed to the 'Data Retention and Deletion' framework as a Pyspark developer. Conducted proof-of-concept (POC) projects including the integration of Azure Table Storage using Python SDK and the implementation of Confluent Kafka with Azure Function Apps for event-driven data ingestion. Additionally, I configured Azure Purview to enhance data governance and compliance, facilitating comprehensive data discovery and management across the organization.

Education

i have completed a btech in mechanical engineering from shard institute,ichalkaranji,maharashtra. 

Professionals in the same Technology / Internet sector as Piyush Joshi

Professionals from different sectors near Pune, Pune

Other users who are called Piyush

Jobs near Pune, Pune

  • Work in company

    Azure Data Lead

    Evnek

    We are looking for an experienced Azure Data & Analytics professional to design, develop and optimize scalable cloud-based data engineering and analytics solutions. · 10-12 years of overall experience in Azure data platforms. · ...

    Pune

    3 weeks ago

  • Work in company

    Azure Data Engineer

    Peoplefy Infosolutions

    We are looking for an experienced data engineer to work on our team in Pune. The ideal candidate will have 3+ years of experience with Python and Databricks platform, as well as expertise in data structures, ETL/ELT concepts and SQL skills. · Developing and debugging code using P ...

    Pune

    1 week ago

  • Work in company

    Azure Data Engineer

    Cloudesign

    We are seeking an experienced Data Engineer to lead the design and implementation of scalable data solutions on the Azure Data Platform. · Design and implement data pipelines that extract, transform, and load financial data from SAP BW into Azure. · Utilize Azure Functions for st ...

    Pune City

    1 month ago

See jobs in Pune, Pune