Parallelize Blocking API Calls with a Thread Pool
Company: Baseten
Role: Software Engineer
Category: Software Engineering Fundamentals
Difficulty: hard
Interview Round: Technical Screen
Overview: Replace sequential blocking API calls with a bounded thread pool while preserving each result's input association and return order. Define worker limits, timeout and failure semantics, cancellation, cleanup, client safety, and tests for out-of-order completion.