Apply Roofline Analysis to a BF16 MLP Layer
Company: Amazon
Role: Software Engineer
Category: Software Engineering Fundamentals
Difficulty: medium
Interview Round: Technical Screen
Overview: Consider the BF16 layer `Y = GELU(XW + bias) + residual`, where `X` has shape `B x 4096` and `W` has shape `4096 x 4096`. Make the API or object boundaries explicit, then cover invariants, edge cases, testing strategy, and operational trade-offs.
