Explain Transformer, GPT vs BERT, and PR metrics

Q: Explain Transformer, GPT vs BERT, and PR metrics

This is a Software Engineering Fundamentals interview question from ByteDance for Machine Learning Engineer roles. View the full question and solution on PracHub.

Q: How do I approach Software Engineering Fundamentals interview questions?

Software Engineering Fundamentals questions require understanding of core concepts and practice. PracHub provides solutions with explanations to help you master software engineering fundamentals interviews.

Question

Answer the following conceptual questions:

Transformer architecture
- Describe the main components of a Transformer block and what each part does.
GPT vs BERT
- Explain the key differences in architecture usage and pretraining objectives.
- When would you prefer one over the other?
Precision and recall
- Define precision and recall.
- Give an example of how changing a threshold can trade off precision vs recall.
- Mention at least one scenario where you prioritize precision and one where you prioritize recall.

Explain Transformer, GPT vs BERT, and PR metrics

Solution

Comments (0)