Explain LLM fine-tuning and generative models

Q: Explain LLM fine-tuning and generative models

This is a Machine Learning interview question from Google for Software Engineer roles. View the full question and solution on PracHub.

Q: How do I approach Machine Learning interview questions?

Machine Learning questions require understanding of core concepts and practice. PracHub provides solutions with explanations to help you master machine learning interviews.

Question

Loading...

Machine Learning fundamentals (LLM / Generative AI track)

You are interviewed for an ML role focused on LLMs and generative AI.

Part A — LLM fine-tuning

What are common ways to adapt/fine-tune a pretrained LLM for a downstream task?
For each approach, explain how it works , pros/cons , and when you would choose it .
Discuss practical scenario considerations such as:
- limited labeled data
- strict latency/cost constraints
- need for domain adaptation without forgetting general capabilities
- safety/alignment requirements

Part B — Generative models

Explain and compare:

Autoencoders (AE)
Variational Autoencoders (VAE)
Vector-Quantized VAE (VQ-VAE)

For each, cover the objective, training behavior, typical failure modes, and common use cases.

Explain LLM fine-tuning and generative models

Machine Learning fundamentals (LLM / Generative AI track)

Part A — LLM fine-tuning

Part B — Generative models

Solution

Comments (0)