
Piyush Joshi
Technology / Internet
About Piyush Joshi:
I am an azure data engineer with 3.3 years of experience in building and optimizing adf data pipelines and developing Py spark and SQL code for data transformation.Some of my skills are ADF,synapse analytics,azure databricks,azure function app,kafka,azure storage.
Experience
As a junior Azure Data Engineer, I supported development and production bug-fixing activities for the 'Ingestion' framework, ensuring robust and reliable data pipeline operations. I contributed to the 'Data Retention and Deletion' framework as a Pyspark developer. Conducted proof-of-concept (POC) projects including the integration of Azure Table Storage using Python SDK and the implementation of Confluent Kafka with Azure Function Apps for event-driven data ingestion. Additionally, I configured Azure Purview to enhance data governance and compliance, facilitating comprehensive data discovery and management across the organization.
Education
i have completed a btech in mechanical engineering from shard institute,ichalkaranji,maharashtra.
Professionals in the same Technology / Internet sector as Piyush Joshi
Professionals from different sectors near Pune, Pune
Other users who are called Piyush
Jobs near Pune, Pune
-
We are looking for an experienced Azure Data & Analytics professional to design, develop and optimize scalable cloud-based data engineering and analytics solutions. · 10-12 years of overall experience in Azure data platforms. · ...
Pune3 weeks ago
-
We are looking for an experienced data engineer to work on our team in Pune. The ideal candidate will have 3+ years of experience with Python and Databricks platform, as well as expertise in data structures, ETL/ELT concepts and SQL skills. · Developing and debugging code using P ...
Pune1 week ago
-
We are seeking an experienced Data Engineer to lead the design and implementation of scalable data solutions on the Azure Data Platform. · Design and implement data pipelines that extract, transform, and load financial data from SAP BW into Azure. · Utilize Azure Functions for st ...
Pune City1 month ago