Diagnose Search Issues with Relevant Metrics and Solutions
Company: TikTok
Role: Data Scientist
Category: Analytics & Experimentation
Difficulty: medium
Interview Round: Onsite
##### Scenario
Brand clients report that searching their own name (e.g., 'Apple') on the platform surfaces irrelevant or harmful content.
##### Question
Which metrics would you examine to diagnose the search-relevance problem, and how would you structure an approach to resolve it?
##### Hints
Consider precision/recall, CTR, dwell time, harmful-content rate, brand-safety violations, time-series before/after model changes.
Quick Answer: This question evaluates a data scientist's competency in diagnosing search relevance and safety problems through metric selection, time-series and experiment-driven analysis, and root-cause investigation within the Analytics & Experimentation domain.