Design a Platform for Training and Serving ML Models
Company: Amazon
Role: Software Engineer
Category: ML System Design
Difficulty: medium
Interview Round: Onsite
Overview: Design an internal ML platform that lets data scientists train models, register reproducible versions, and deploy them for both online and batch inference. Connect data and model choices to serving architecture, latency and throughput, evaluation, monitoring, failure modes, and iteration.
Read the full Amazon Software Engineer interview experience this question came from