beBee background
Professionals
>
Pune
Piyush Joshi

Piyush Joshi

Azure Data Engineer

Technology / Internet

Pune, Pune

Social

About Piyush Joshi:

I am an azure data engineer with 3.3 years of experience in building and optimizing adf data pipelines and developing Py spark and SQL code for data transformation.Some of my skills are ADF,synapse analytics,azure databricks,azure function app,kafka,azure storage.

Experience

As a junior Azure Data Engineer, I supported development and production bug-fixing activities for the 'Ingestion' framework, ensuring robust and reliable data pipeline operations. I contributed to the 'Data Retention and Deletion' framework as a Pyspark developer. Conducted proof-of-concept (POC) projects including the integration of Azure Table Storage using Python SDK and the implementation of Confluent Kafka with Azure Function Apps for event-driven data ingestion. Additionally, I configured Azure Purview to enhance data governance and compliance, facilitating comprehensive data discovery and management across the organization.

Education

i have completed a btech in mechanical engineering from shard institute,ichalkaranji,maharashtra. 

Professionals in the same Technology / Internet sector as Piyush Joshi

Professionals from different sectors near Pune, Pune

Other users who are called Piyush

Jobs near Pune, Pune

  • Azure Data Engineer

    3 weeks ago

    Unicon Connectors Pune

    · Azure Data Engineer. · Experience in Data engineering projects using Microsoft Azure platform (Min 2-3 projects) · , Strong expertise in data engineering tools and storage such as Azure ADLS Gen2,Blob storage, · ,Ability to implement Synapse pipelines for data integration ETL/ ...

  • Azure Data Engineer

    6 days ago

    confidential Pune

    We are seeking a skilled Azure Data Engineer to join our team in India. · ...

  • Azure Data Lead

    1 day ago

    Zimetrics Pune

    As an Azure Data Lead at Zimetrics, you will: · Lead data analysis, data modeling, and reporting initiatives. · Partner with business stakeholders to understand requirements and translate them into scalable data solutions. · Collaborate with data engineering teams to design and m ...

See jobs in Pune, Pune