Design an Incremental Rolling-Metrics Data Pipeline
Company: Jain Global
Role: Data Engineer
Category: System Design
Difficulty: medium
Interview Round: Technical Screen
Overview: Design a production pipeline for rolling metrics over historical and daily ticker observations, with fast analyst and dashboard reads. The case examines bounded recomputation for corrections, versioned lineage, idempotent atomic publication, columnar partitioning, validation, backfills, orchestration, and proof that incremental results match a full rebuild.