Streaming Entropy with Numerical Stability
Company: OpenAI
Role: Machine Learning Engineer
Category: Coding & Algorithms
Difficulty: hard
Interview Round: Technical Screen
Quick Answer: This question tests a candidate's ability to implement numerically stable online algorithms for computing Shannon entropy over streaming data. It evaluates mastery of floating-point precision, O(1) incremental state maintenance, and information-theoretic concepts applied to unbounded sequences — skills central to machine learning engineering roles.