beBee background
Professionals
>
Bengaluru
Pavan Kumar M

Pavan Kumar M

Data Engineer

Technology / Internet

Bengaluru, Bengaluru Urban

Social


Services offered

Working as Data Engineer at Startup for IoT Product client and previously for Britannia FMCG.

I have skills in Python, Mysql, MongoDb, Redis, Airflow, AWS (S3, Cloudwatch, lambda and Redshift), Docker and Kafka. Currently working on my Pyspark things.

Approximate rate: ₹ 1,000 per hour

Experience

Britannia BrandOps Sales Analysis Data Pipeline

Engineered a comprehensive ETL pipeline for a leading FMCG brand, streamlining the extraction and transformation

of sales data, enhancing reporting accuracy and speeding up decision-making processes by 40 hours monthly.

Optimized SQL queries and data processing workflows, reducing execution time by 30% and improving system

efficiency.

Integrated AWS services (S3, Lambda, Redshift) with data processing pipelines, enabling real-time analytics and

streamlining reporting processes.

Developed interactive dashboards using Tableau, enhancing data visualization and accessibility for stakeholders,

thereby supporting business intelligence efforts.

Worked with cross-functional teams to implement data warehousing solutions, enhancing data accessibility and

supporting business intelligence initiatives.

Managed Dockerized applications for efficient deployment and container orchestration, ensuring seamless

integration with Apache Airflow for task automation.

 

Smart Grow Agritech IoT Product Data Pipeline

Led the Smart Grow project aimed at optimizing plant growth data management and quality control operations,

improving data processing speed by 50%.

Engineered robust data pipelines to process over 10,000 sensor data points and integrate them with lab results for

real-time tracking and analysis using Kafka, MongoDB, and Airflow.

Developed a system that automatically creates and updates mileposts, providing insights into 95% of plant growth

stages and quality metrics.

Structured data to ensure seamless integration with QBench, improving workflow efficiency by 30%.

Leveraged Docker and Airflow for automating task orchestration and containerized deployments, facilitating

efficient handling of large data volumes.

Processed over 1 million records, significantly improving decision-making for agronomic operations

Education

bachelor's of Education (Electronic and Communications Engineering)

Professionals in the same Technology / Internet sector as Pavan Kumar M

Professionals from different sectors near Bengaluru, Bengaluru Urban

Other users who are called Pavan

Jobs near Bengaluru, Bengaluru Urban

  • Work in company

    Data Engineer

    Amazon India Limited

    We're seeking an exceptional Data Engineer to join our Risk and Compliance Solutions (RCS) Data Engineering team where you'll architect and build data systems that power Amazon's compliance operations. · ...

    Bengaluru, Karnataka, IND

    3 weeks ago

  • Work in company

    Data Engineer

    IntraEdge

    We are looking for a skilled Data Engineer with strong expertise in Python and SQL to design, build, and maintain scalable data pipelines and infrastructure. · Design, develop, and maintain scalable ETL/ELT data pipelines. · Write complex, optimized SQL queries for large-scale da ...

    Bengaluru

    1 week ago

  • Work in company

    Data Engineer

    DMARC Analyzer (Acq. by Mimecast)

    We are seeking a highly skilled Data Engineer with deep expertise in SQL and strong proficiency in Snowflake data warehousing. · ...

    Bengaluru

    2 weeks ago