
Pavan Kumar M
Technology / Internet
Services offered
Working as Data Engineer at Startup for IoT Product client and previously for Britannia FMCG.
I have skills in Python, Mysql, MongoDb, Redis, Airflow, AWS (S3, Cloudwatch, lambda and Redshift), Docker and Kafka. Currently working on my Pyspark things.
Experience
Britannia BrandOps Sales Analysis Data Pipeline
•
Engineered a comprehensive ETL pipeline for a leading FMCG brand, streamlining the extraction and transformation
of sales data, enhancing reporting accuracy and speeding up decision-making processes by 40 hours monthly.
•
Optimized SQL queries and data processing workflows, reducing execution time by 30% and improving system
efficiency.
•
Integrated AWS services (S3, Lambda, Redshift) with data processing pipelines, enabling real-time analytics and
streamlining reporting processes.
•
Developed interactive dashboards using Tableau, enhancing data visualization and accessibility for stakeholders,
thereby supporting business intelligence efforts.
•
Worked with cross-functional teams to implement data warehousing solutions, enhancing data accessibility and
supporting business intelligence initiatives.
•
Managed Dockerized applications for efficient deployment and container orchestration, ensuring seamless
integration with Apache Airflow for task automation.
Smart Grow Agritech IoT Product Data Pipeline
•
Led the Smart Grow project aimed at optimizing plant growth data management and quality control operations,
improving data processing speed by 50%.
•
Engineered robust data pipelines to process over 10,000 sensor data points and integrate them with lab results for
real-time tracking and analysis using Kafka, MongoDB, and Airflow.
•
Developed a system that automatically creates and updates mileposts, providing insights into 95% of plant growth
stages and quality metrics.
•
Structured data to ensure seamless integration with QBench, improving workflow efficiency by 30%.
•
Leveraged Docker and Airflow for automating task orchestration and containerized deployments, facilitating
efficient handling of large data volumes.
•
Processed over 1 million records, significantly improving decision-making for agronomic operations
Education
bachelor's of Education (Electronic and Communications Engineering)
Professionals in the same Technology / Internet sector as Pavan Kumar M
Professionals from different sectors near Bengaluru, Bengaluru Urban
Other users who are called Pavan
Jobs near Bengaluru, Bengaluru Urban
-
+ Design clean, scalable, and reliable data models using DBT. + Write performant SQL and Python code to transform raw data into structured marts and reporting layers. ...
Bangalore3 weeks ago
-
Data Engineer – Azure Data Platforms & Power BI (JG5 | Onsite,Bangalore) · We're supporting a global organization within the energy and data & analytics domain on enterprise-scale data initiatives across multiple commodities. · ...
Bangalore Urban, Karnataka1 month ago
-
Overview · We are looking for an experienced professional with strong expertise in Data Engineering and Python Programming. This role involves designing scalable data pipelines, ensuring data quality and governance, and enabling end-to-end machine learning model deployment in pro ...
Bengaluru3 days ago