Debug a Transformer bug in an unfamiliar repo

Q: How do I approach Software Engineering Fundamentals interview questions?

Software Engineering Fundamentals questions require understanding of core concepts and practice. PracHub provides solutions with explanations to help you master software engineering fundamentals interviews.

Q: What difficulty level is this interview question?

This is a medium difficulty Software Engineering Fundamentals question, commonly asked during Onsite rounds at Lila.

Q: What role is this question designed for?

This question is commonly asked for Machine Learning Engineer candidates at Lila during technical interviews.

Question

Debug a Transformer bug in an unfamiliar repo

PracHub · Accepted Answer

This question evaluates proficiency in debugging Transformer implementations, encompassing codebase navigation, tensor shape and broadcasting reasoning, numerical stability, masking/causality checks, and model validation competencies.

Debug a Transformer bug in an unfamiliar repo

Quick Overview

Debug a Transformer bug in an unfamiliar repo

Write your answer