Explain an ML Project from Model Development Through Deployment
Company: Capital One
Role: Data Scientist
Category: ML System Design
Difficulty: medium
Interview Round: Technical Screen
Choose one machine-learning project from your experience and explain it from problem definition through online deployment. Focus on how you selected the model, validated it, and made the training and serving workflow reliable.
### Constraints & Assumptions
- The interviewer may probe any technical claim, so distinguish what you personally owned from what the team owned.
- Use only project details you can discuss; replace sensitive values with qualitative trade-offs when necessary.
- The model supported an operational or product decision rather than existing only as an offline analysis.
### Clarifying Questions to Ask
- Should the discussion emphasize modeling depth, production architecture, or business impact?
- Is a batch-scoring or online-inference example more relevant?
- How much implementation detail is useful given the interview time?
### What a Strong Answer Covers
- A crisp problem statement, prediction unit, target, users of the output, and decision-relevant success criteria.
- Data lineage, leakage prevention, validation design, baseline choice, and model-selection evidence.
- The candidate's concrete contributions and the trade-offs behind important decisions.
- Training-serving feature parity, versioning, deployment strategy, monitoring, rollback, and retraining.
- Offline and online results described honestly, including limitations, failure modes, and lessons learned.
- Communication appropriate for both technical partners and decision makers.
### Follow-up Questions
1. Why did your selected model beat the strongest reasonable baseline?
2. What was the most damaging failure mode, and how did you discover it?
3. How did you know an offline improvement would matter online?
4. What would you redesign if you built the system again?
Quick Answer: Prepare a data science project walkthrough that connects the prediction target and validation design to an operational decision. Explain model selection, personal ownership, training-serving consistency, deployment, monitoring, rollback, and the difference between offline evidence and online impact.