This question evaluates a candidate's competency in product analytics, causal diagnosis, instrumentation and logging validation, segmentation and cohort analysis, and experimental design for feed ranking and user-path behavior.
You are interviewing for a product data science role at LinkedIn. Answer the following two product-sense questions.
LinkedIn notices that weekly traffic from the Home Page to the Profile Page has declined materially. You are asked to determine whether this is a product problem, a logging issue, a traffic-mix shift, or an intentional product improvement.
Describe how you would investigate this decline. Your answer should include:
You may assume LinkedIn recently launched a new inline profile preview feature on the Home Page: when a user hovers over a member's name or card, they can see key profile information without opening the full Profile Page.
LinkedIn plans to change the Home Feed default ranking from showing all content to showing only content deemed most relevant to each viewer.
Design an experiment and success framework for this change. Your answer should include:
Be explicit about metric tradeoffs, potential selection bias or traffic-mix confounding, and how you would decide whether the launch is successful.