ML Pipeline Stability & Evaluation
Company: Microsoft
Role: Product Manager
Category: Product / Decision Making
Difficulty: medium
Interview Round: HR Screen
##### Question
Your time-series machine-learning pipeline has become unstable and prediction accuracy is dropping.
Describe how you would diagnose the root cause across data ingestion, feature generation, and model-serving layers.
Explain the evaluation framework, sampling strategy, and metrics you would use to quantify performance regressions.
Outline the technical fixes and process changes you would implement to restore stability and prevent future issues.
Quick Answer: This question evaluates a product manager's ability to diagnose and stabilize an end-to-end time-series ML pipeline, testing competencies in data ingestion, feature engineering, model training and serving, evaluation frameworks, and remediation planning.