Real-Time Event Pipeline
Legacy batch pipeline couldn't handle peak traffic spikes, causing 4-6 hour data delays in downstream ML models.
Role: Lead Data Engineer
Impact
→Handled 12M+ events/day
→Reduced end-to-end latency from 4h to 90s
→99.97% uptime over 6 months