Hardeep Singh

Innovative and experienced Data Engineer with 4+ Years of experience, driving team vision proactively in building and maintaining scalable, robust and performant data pipelines. Excellent drive data-driven insights that optimized business processes and support growth.

EY GS (Nov 2024 - Present)

Senior Data Engineer

• Led end-to-end design, developed, and tested data pipeline solutions.
• Automated business validations to streamline audit processes and reduce manual effort.
• Deployed Databricks jobs using Asset Bundles and wheel files to manage Bronze, Silver, and Gold layer ingestion.
• Implemented robust alerting mechanisms to notify users of failures during data ingestion and transformation at any stage, ensuring faster resolution and minimal data downtime.
• Monitored production jobs and implemented orchestration for smooth operation.

Tata Consultancy Services (Nov 2020 - Nov 2024)

Data Engineer

• Built and maintained automated, reliable production ready pipelines for multiple clients, to ensure timely delivery of high-quality data.
• Prevented storage account throttling which in turn stopped job failures.
• Designed and developed automation scripts for multiple data pipelines, reducing developer time in unit testing by 25%.
• Built and enhanced the data model for Ecommerce platforms in collaboration with data modelling teams.
• Used agile methodologies for project management
• Ensured delivery of high-quality work and promoting an environment of continuous learning and improvement.
• Conducted data analysis to identify data quality issues and implement solutions.

Bachelor of Technology

Majors: Computer Science & Engineering

Deenbandhu Chhotu Ram University of Science and Technology (2016-2020)

Certificate of Paper Presentation

Students Placement & Career Prediction using Machine Learning 2021