Compare Reward-Model RLHF and Direct Preference Optimization
Company: Mistral AI
Role: Software Engineer
Category: Machine Learning
Difficulty: medium
Interview Round: Technical Screen
Overview: Compare reward-model RLHF and DPO through preference data, policy objectives, reference regularization, training stages, and evaluation under distribution shift.
Read the full Mistral AI Software Engineer interview experience this question came from