Debug a Transformer bug in an unfamiliar repo

Read the full interview experience this question came from →

Quick Overview

This question evaluates proficiency in debugging Transformer implementations, encompassing codebase navigation, tensor shape and broadcasting reasoning, numerical stability, masking/causality checks, and model validation competencies.

Debug a Transformer bug in an unfamiliar repo

Company: Lila

Role: Machine Learning Engineer

Category: Software Engineering Fundamentals

Difficulty: medium

Interview Round: Onsite

Overview: This question evaluates proficiency in debugging Transformer implementations, encompassing codebase navigation, tensor shape and broadcasting reasoning, numerical stability, masking/causality checks, and model validation competencies.

Read the full Lila Machine Learning Engineer interview experience this question came from

|Home/Software Engineering Fundamentals/Lila
Lila logo
Lila
Jan 9, 2026
mediumMachine Learning EngineerOnsiteSoftware Engineering Fundamentals
6
0
Loading...
Loading comments...