Project STREAM: Real-Time Project Management

Objective: Develop a robust system for managing real-time data processing platform projects, contracts, and

budgets, integrated with SAP and IBM Planning Analytics. Team Size: 15+ developers and senior developers.
Key Metrics & Challenges:

• Designed a system to manage 100+ ongoing projects simultaneously, handling a large volume of purchase orders and budgets totaling over $2+ billions.
• Initial challenges with handling the large influx of real-time data resulted in performance degradation. Resolved this by optimising Kafka configurations, increasing partition counts, and implementing dynamic scaling using MCC cloud infrastructure.
• Ensured 99.9% uptime by architecting the platform with a microservices architecture using Node.js and TypeScript, enabling fault tolerance and continuous system operation even during peak loads.
• Faced slow query performance while integrating with SAP. To resolve, optimised database schema and used MS-SQL stored procedures, which improved query performance by 30%. 
• Implemented CQRS pattern to isolate the command and query calls (especially by redirecting the correct write and read calls to the SQL server replica).
• Integration with SAP and IBM Planning Analytics required significant custom API development, resulting in initial delays. Through better cross-team collaboration, these were resolved in three months, enabling seamless data transfer and synchronisation.
• Reduced cloud costs by 20% through automated scaling mechanisms and optimising resource allocation in MCC cloud, particularly during off-peak hours.