beBee background
Professionals
>
Technology / Internet
>
Mumbai
Ashutosh  Yadav

Ashutosh Yadav

Data Engineer

Services provided: Apache Spark , AWS Developer , Databricks , Pyspark , Java / Python , SQL , Azure

Mumbai, Maharashtra
$30 / hour
Approximate rate

Social


About Ashutosh Yadav:

I am an experienced Data Engineer with a passion for leveraging cloud-based technologies to build data-driven solutions. I have a strong background in designing, implementing, and maintaining data pipelines using Azure technologies. 

Experience

Lentra AI (April 2023- Present):

  • Led the migration of legacy data infrastructure to Apache Pinot, enabling real-time data analytics and efficient querying capabilities.
  • Utilised Bitbucket for version control, collaborating with the development team to manage code repositories and streamline the deployment process.
  • Collaborated with cross-functional teams, including data scientists, analysts, and product managers, to understand the business requirements and translate them into effective data models.
  • Designed and implemented schema structures in Apache Pinot, ensuring optimal data storage, query performance, and scalability to meet analytical demands.
  • Conducted knowledge sharing sessions and workshops to educate team members about Apache Pinot's capabilities and how to effectively leverage its features.

Celebal Technologies (Sept 2021- March 2023)

  • Developed Spark applications using Pyspark and Spark-SQL for data extraction, transformation, and aggregation from multiple file formats for analyzing & transforming the data to uncover insights into customer usage patterns.
  • Extract Transform and Load data from Sources Systems to Azure Data Storage services using a combination of Azure Data Factory, and, Spark SQL. Data Ingestion to one or more Azure Services - (Azure Data Lake, Azure Storage) and processing the data in Azure Databricks.
  • Participated in data quality checks and monitoring to ensure data integrity and accuracy.
  • Created Pipelines in ADF using Linked Services/Datasets/ Pipeline/ to Extract, Transform and load data from different sources like Blob Storage, Azure SQL Data Warehouse, write- back tool, and backward.
  • Automated ELT processes, via email to destination using Azure Logic Apps and Data factory and translated the data into actionable reports in Power BI.
  • Generated & maintained scalable data pipelines and built new API integrations to support data volume & complexity. Data Transformations were done on Azure Databricks.
  • Collaborated with the analytics team to enhance business intelligence tools. Implemented processes to monitor data quality and ensured accurate production data by 100%

Education

Masters in Computer Applications

  • Vellore Institute of Technology       (2020 - 2022)

Bachelors of Science in Information Technology

  • Mumbai University (2016 - 2019)

Professionals who compete with Ashutosh

Professionals offering similar services to those of Ashutosh Yadav

Professionals in the same Technology / Internet sector as Ashutosh Yadav

Professionales offering Apache Spark services

Professionales offering AWS Developer services

Professionales offering Databricks services

Professionales offering Pyspark services

Professionales offering Java / Python services

Professionales offering SQL services

Professionales offering Azure services

Professionals from different sectors near Mumbai, Maharashtra

Other users who are called Ashutosh

Jobs near Mumbai, Maharashtra

  • Torque Communications

    Public Relations Specialist

    Found in: Appcast Linkedin IN C2 - 2 days ago


    Torque Communications Mumbai, India

    Torque Communications ), an agency with a rich history of 20 years, is looking for Communications professionals for managing client relationships, developing and executing content strategies, and fostering media relations. This multifaceted role requires a proactive and detail-or ...

  • Mizuho

    Operational Risk Analyst

    Found in: Talent IN 2A C2 - 2 days ago


    Mizuho Navi Mumbai, India

    Mizuho Global Services India Pvt. Ltd. · Mizuho Global Services Pvt Ltd (MGS) is a subsidiary company of Mizuho Bank, Ltd, which is one of the largest banks or so called 'Mega Banks' of Japan. MGS was established in the year 2020 as part of Mizuho's long-term strategy of creating ...

  • Qrata

    Executive Assistant

    Found in: Talent IN 2A C2 - 2 days ago


    Qrata Mumbai, India

    Objectives of this role · • Support the CEO primarily and provide additional support to executive team members, as directed, to ensure that company goals and objectives are accomplished and that operations run efficiently · • Maintain and refine internal processes that support h ...