beBee background
Professionals
>
Pune
Piyush Joshi

Piyush Joshi

Azure Data Engineer

Technology / Internet

Pune, Pune

Social

About Piyush Joshi:

I am an azure data engineer with 3.3 years of experience in building and optimizing adf data pipelines and developing Py spark and SQL code for data transformation.Some of my skills are ADF,synapse analytics,azure databricks,azure function app,kafka,azure storage.

Experience

As a junior Azure Data Engineer, I supported development and production bug-fixing activities for the 'Ingestion' framework, ensuring robust and reliable data pipeline operations. I contributed to the 'Data Retention and Deletion' framework as a Pyspark developer. Conducted proof-of-concept (POC) projects including the integration of Azure Table Storage using Python SDK and the implementation of Confluent Kafka with Azure Function Apps for event-driven data ingestion. Additionally, I configured Azure Purview to enhance data governance and compliance, facilitating comprehensive data discovery and management across the organization.

Education

i have completed a btech in mechanical engineering from shard institute,ichalkaranji,maharashtra. 

Professionals in the same Technology / Internet sector as Piyush Joshi

Professionals from different sectors near Pune, Pune

Other users who are called Piyush

Jobs near Pune, Pune

  • Tata Consultancy Services

    Azure Data Engineer

    2 days ago

    Tata Consultancy Services Pune

    Azure Data Engineer · Exp:8 - 11years · Location: Pune and Hyderabad · Required Skills: Databricks, SSIS, SQL, Azure databricks, Pyspark · Must-Have** · Total 7+ years of exp with at least 5+ years of relevant experience in Pyspark and Azure Databricks. · Proficiency in integra ...

  • beBee Careers

    Azure Big Data Engineer

    1 week ago

    beBee Careers Pune

    We are looking for a skilled Azure Data Engineer to join our team. In this role, you will be responsible for building, deploying, and maintaining large-scale data processing systems using Azure Data Bricks, Python, or Spark/Scala. Your expertise in Data Warehouse/Data Lake develo ...

  • beBee Careers

    Data Engineer - Azure Cloud Solutions

    2 weeks ago

    beBee Careers Pune

    Salary: Competitive salary based on experience. · Job Description: · We are seeking a skilled Azure Data Engineer to lead and drive analytics initiatives. As an Azure Data Engineer, you will be responsible for designing, implementing, and scaling reliable and efficient data model ...

See jobs in Pune, Pune