beBee background
Professionals
>
Bengaluru
Pavan Kumar M

Pavan Kumar M

Data Engineer

Technology / Internet

Bengaluru, Bengaluru Urban

Social


Services offered

Working as Data Engineer at Startup for IoT Product client and previously for Britannia FMCG.

I have skills in Python, Mysql, MongoDb, Redis, Airflow, AWS (S3, Cloudwatch, lambda and Redshift), Docker and Kafka. Currently working on my Pyspark things.

Approximate rate: ₹ 1,000 per hour

Experience

Britannia BrandOps Sales Analysis Data Pipeline

Engineered a comprehensive ETL pipeline for a leading FMCG brand, streamlining the extraction and transformation

of sales data, enhancing reporting accuracy and speeding up decision-making processes by 40 hours monthly.

Optimized SQL queries and data processing workflows, reducing execution time by 30% and improving system

efficiency.

Integrated AWS services (S3, Lambda, Redshift) with data processing pipelines, enabling real-time analytics and

streamlining reporting processes.

Developed interactive dashboards using Tableau, enhancing data visualization and accessibility for stakeholders,

thereby supporting business intelligence efforts.

Worked with cross-functional teams to implement data warehousing solutions, enhancing data accessibility and

supporting business intelligence initiatives.

Managed Dockerized applications for efficient deployment and container orchestration, ensuring seamless

integration with Apache Airflow for task automation.

 

Smart Grow Agritech IoT Product Data Pipeline

Led the Smart Grow project aimed at optimizing plant growth data management and quality control operations,

improving data processing speed by 50%.

Engineered robust data pipelines to process over 10,000 sensor data points and integrate them with lab results for

real-time tracking and analysis using Kafka, MongoDB, and Airflow.

Developed a system that automatically creates and updates mileposts, providing insights into 95% of plant growth

stages and quality metrics.

Structured data to ensure seamless integration with QBench, improving workflow efficiency by 30%.

Leveraged Docker and Airflow for automating task orchestration and containerized deployments, facilitating

efficient handling of large data volumes.

Processed over 1 million records, significantly improving decision-making for agronomic operations

Education

bachelor's of Education (Electronic and Communications Engineering)

Professionals in the same Technology / Internet sector as Pavan Kumar M

Professionals from different sectors near Bengaluru, Bengaluru Urban

Other users who are called Pavan

Jobs near Bengaluru, Bengaluru Urban

  • Work in company

    Data Engineer

    Euphoric Thought Technologies

    + Design clean, scalable, and reliable data models using DBT. + Write performant SQL and Python code to transform raw data into structured marts and reporting layers. ...

    Bangalore

    3 weeks ago

  • Work in company

    Data Engineer

    XML International

    Data Engineer – Azure Data Platforms & Power BI (JG5 | Onsite,Bangalore) · We're supporting a global organization within the energy and data & analytics domain on enterprise-scale data initiatives across multiple commodities. · ...

    Bangalore Urban, Karnataka

    1 month ago

  • Work in company

    Data Engineer

    AtkinsRéalis

    Overview · We are looking for an experienced professional with strong expertise in Data Engineering and Python Programming. This role involves designing scalable data pipelines, ensuring data quality and governance, and enabling end-to-end machine learning model deployment in pro ...

    Bengaluru

    3 days ago