Analytics & Experimentation Interview Questions
Master your tech interview with our curated database of real questions from top companies.
Identify User Interest in Group Video Calls Using Data
Group Video-Calling Feature Analysis Context You are asked to design, launch, and analyze a new group video-calling feature for a large social/messagi...
Evaluating a 15 % reduction in post‑card height
Scenario You own the feed UX for a social app. Designers propose shrinking each post card’s height by 15% to show more content per scroll, aiming to i...
Evaluate Impact of Bicycle Deliveries on Efficiency and Costs
Scenario A food-delivery marketplace plans to let couriers (dashers) opt in to deliver by bicycle in addition to cars. Question State the primary busi...
Design A/B Test for Cost-Per-Conversion Efficiency Analysis
Multi-Arm A/B Test: Comparing Cost-Per-Conversion Across Channels Scenario You need to compare four new acquisition channels—YouTube ads, Google Searc...
Analyze Causes of Increased Lyft Ride Wait Times
Scenario A ride-hailing marketplace observes a 20% month-over-month increase in rider wait time (time from request to driver arrival). Tasks 1) Root-c...
Design an Experiment to Evaluate New Recommendation Model
Experiment Design: New Ads Ranking Model vs. Current System Context You are evaluating a newly built ML ranking model for an ads recommendation surfac...
Diagnose Discrepancy in A/B Test Conversion Rate Results
A/B Test Design: Personalized Marketing Emails and Conversion Lift Scenario An e-commerce firm wants to send personalized marketing emails to increase...
Measure Billboard Campaign Impact: Design, Bias, Test Strategy
Measuring Billboard Impact on Brand Awareness Scenario A marketing team launched billboard ads in several cities and wants to estimate the campaign's ...
Analyze A/B Test Results for Subscription Conversion Rates
A/B Test: Free-Trial Offer Impact on Paid Subscriptions and Churn Context You are analyzing an A/B test where free users in the Treatment arm are offe...
Estimate Redesign Impact Using Propensity Score Matching
Scenario A mobile app has been redesigned. Adoption is voluntary: users choose to upgrade to the new version over time. The team needs to estimate the...
Analyze Retention Data for Geo-Targeted Feature Launch
Business Case: Geo-Targeted Feature with Limited Traffic and Retention Curves Scenario You are evaluating whether to launch a new geo-targeted product...
Calculate Profitability and Evaluate Partnership for Credit Card Portfolio
Credit-Card Portfolio Profitability and Partnership Evaluation Context You are analyzing a mature credit-card portfolio to assess its current profitab...
Evaluate the Success of Instagram Checkout
Scenario You are evaluating whether to launch Instagram Checkout, which allows users to purchase products without leaving Instagram. Your task is to a...
How to Validate Friends' Content Engagement Hypothesis?
Evaluating Friends' vs Unconnected Content in the Info Stream Context The Info Stream currently prioritizes content from a user's friends. The product...
Diagnose Job-Application Decline: Funnel Stages and KPIs Analysis
Diagnostic Case: Drop in Job Applications Context You are a data scientist at a large job‑search platform. The primary metric "job applications submit...
Evaluate Financial Feasibility of Ride-Sharing Service
Ride-Share Pricing, Capacity, and Profitability Case Context (assumptions made explicit) - Each driver can complete up to 5 rides per hour and works a...
Design Experiment to Evaluate New Video-Ad Effectiveness
Experiment Design: Measuring the Impact of a New Video‑Ad Format Context You are designing an experiment for a large consumer app that runs an ad auct...
Evaluate Metrics for Restaurant-Feature Impact and Engagement Trade-offs
Product Analytics Case: Restaurant Recommendations vs. New-Friend Suggestions Background You are a data scientist at a large social app. The app launc...
Estimate Super Bowl QR Code Scan Rate Using Historical Data
Estimating QR Scan and Sign-up Conversion for a Super Bowl TV Ad Scenario A Super Bowl TV ad prominently features a QR code and a clear call-to-action...
Advertising for local businesses boosting popular posts
Boosting Popular Posts for Local SMBs: Definitions, Success Metrics, and Diagnosing Low CTR Context You are evaluating an experiment where small, loca...