beBee background
Professionals
>
Pune
Piyush Joshi

Piyush Joshi

Azure Data Engineer

Technology / Internet

Pune, Pune

Social


About Piyush Joshi:

I am an azure data engineer with 3.3 years of experience in building and optimizing adf data pipelines and developing Py spark and SQL code for data transformation.Some of my skills are ADF,synapse analytics,azure databricks,azure function app,kafka,azure storage.

Experience

As a junior Azure Data Engineer, I supported development and production bug-fixing activities for the 'Ingestion' framework, ensuring robust and reliable data pipeline operations. I contributed to the 'Data Retention and Deletion' framework as a Pyspark developer. Conducted proof-of-concept (POC) projects including the integration of Azure Table Storage using Python SDK and the implementation of Confluent Kafka with Azure Function Apps for event-driven data ingestion. Additionally, I configured Azure Purview to enhance data governance and compliance, facilitating comprehensive data discovery and management across the organization.

Education

i have completed a btech in mechanical engineering from shard institute,ichalkaranji,maharashtra. 

Professionals in the same Technology / Internet sector as Piyush Joshi

Professionals from different sectors near Pune, Pune

Other users who are called Piyush

Jobs near Pune, Pune

  • Work in company

    Azure Data Engineer

    Gateway Group

    We are looking for a skilled Azure Data Engineer to work on enterprise-scale data projects. · ...

    Pune

    1 month ago

  • Work in company

    Azure Data Engineer

    BSR & Co

    Description · Azure data engineering - Manager · Responsibilities · Delivery and Presales · Qualifications · BE/Mtech · ...

    Pune, Maharashtra, India

    1 week ago

  • Work in company

    Microsoft Fabric, Azure Data engineer

    Tata Consultancy Services

    Experience in data engineering with strong Azure cloud background. · ...

    Pune, Maharashtra

    3 weeks ago