Design a Hybrid Evaluation Platform
Company: Waymo
Role: Software Engineer
Category: ML System Design
Difficulty: medium
Interview Round: Onsite
Overview: This question evaluates skills in designing scalable ML evaluation platforms, covering architecture, data modeling, human-in-the-loop workflows, LLM-based automated judging, calibration strategies, reliability checks, and measurement of evaluator agreement and score quality.