Practice the exact questions companies are asking right now.
System Design: Routing Layer for Heterogeneous Inference Backends (GPU/CPU) Context You are asked to design a routing layer that sits between a user-f...