Explain why CTR rises but CVR unchanged

Q: Explain why CTR rises but CVR unchanged

This is a Analytics & Experimentation interview question from Amazon for Machine Learning Engineer roles. View the full question and solution on PracHub.

Q: How do I approach Analytics & Experimentation interview questions?

Analytics & Experimentation questions require understanding of core concepts and practice. PracHub provides solutions with explanations to help you master analytics & experimentation interviews.

Question

Loading...

Experiment analysis (CTR up, CVR flat)

You run an online experiment on an e-commerce product detail page that launches a new UI.

Primary observation: CTR increases , but purchase conversion rate (CVR) does not change .

Questions

Using statistical/experimental analysis, how would you investigate why CTR improved but CVR did not?
Follow-up: You want to analyze the effect by user tier (stratified analysis). One tier has very small sample size . What statistical approach would you use to still make a reasonable inference?

Explain why CTR rises but CVR unchanged

Experiment analysis (CTR up, CVR flat)

Questions

Solution

Comments (0)