PracHub
QuestionsPremiumLearningGuidesCheatsheetNEWCoaches
|Home/Analytics & Experimentation/PayPal

Evaluate smart cart idea with hypotheses and experiment

Last updated: Mar 29, 2026

Quick Overview

This Analytics & Experimentation prompt evaluates experimental design, causal inference, product-metrics definition, instrumentation and diagnostic/guardrail metric selection at a senior-level Data Scientist abstraction for a physical-retail smart-cart feature.

  • medium
  • PayPal
  • Analytics & Experimentation
  • Data Scientist

Evaluate smart cart idea with hypotheses and experiment

Company: PayPal

Role: Data Scientist

Category: Analytics & Experimentation

Difficulty: medium

Interview Round: Onsite

Instacart partners with a local grocery store to introduce a “smart cart” in the physical store. The smart cart UI lets shoppers: 1) search/browse items that exist in the current store and see in-store prices, and 2) also see items and prices from other nearby stores available on the Instacart app. You are a Senior Data Scientist asked to evaluate whether this is a good product idea. 1) What are the key hypotheses (primary and secondary) for how this smart cart could impact the business? Consider potential positive and negative effects. 2) What metrics would you track? Specify at least: - a primary success metric, - 2–4 supporting diagnostic metrics, - 1–3 guardrail metrics. Make sure you address tradeoffs like cross-store switching/cannibalization and user experience. 3) How would you design an experiment to measure causal impact? Include: - unit of randomization (user, trip, cart, store, day, etc.), - how you would handle interference/spillovers (e.g., shoppers seeing others use the cart), - required logging/instrumentation, - rough power/MDE considerations and how you’d estimate them. 4) If you cannot run a clean randomized experiment, propose a credible quasi-experimental alternative (e.g., diff-in-diff) and key assumptions to validate.

Quick Answer: This Analytics & Experimentation prompt evaluates experimental design, causal inference, product-metrics definition, instrumentation and diagnostic/guardrail metric selection at a senior-level Data Scientist abstraction for a physical-retail smart-cart feature.

Related Interview Questions

  • How would you measure impact? - PayPal (medium)
  • How to evaluate a new homepage feature - PayPal (easy)
  • Design and evaluate a fraud detection strategy - PayPal (easy)
  • Design a fraud mitigation strategy under constraints - PayPal (hard)
  • Design metrics and experiment for donation feature - PayPal (easy)
PayPal logo
PayPal
Dec 10, 2025, 12:00 AM
Data Scientist
Onsite
Analytics & Experimentation
1
0

Instacart partners with a local grocery store to introduce a “smart cart” in the physical store.

The smart cart UI lets shoppers:

  1. search/browse items that exist in the current store and see in-store prices, and
  2. also see items and prices from other nearby stores available on the Instacart app.

You are a Senior Data Scientist asked to evaluate whether this is a good product idea.

  1. What are the key hypotheses (primary and secondary) for how this smart cart could impact the business? Consider potential positive and negative effects.
  2. What metrics would you track? Specify at least:
    • a primary success metric,
    • 2–4 supporting diagnostic metrics,
    • 1–3 guardrail metrics. Make sure you address tradeoffs like cross-store switching/cannibalization and user experience.
  3. How would you design an experiment to measure causal impact? Include:
    • unit of randomization (user, trip, cart, store, day, etc.),
    • how you would handle interference/spillovers (e.g., shoppers seeing others use the cart),
    • required logging/instrumentation,
    • rough power/MDE considerations and how you’d estimate them.
  4. If you cannot run a clean randomized experiment, propose a credible quasi-experimental alternative (e.g., diff-in-diff) and key assumptions to validate.

Solution

Show

Comments (0)

Sign in to leave a comment

Loading comments...

Browse More Questions

More Analytics & Experimentation•More PayPal•More Data Scientist•PayPal Data Scientist•PayPal Analytics & Experimentation•Data Scientist Analytics & Experimentation
PracHub

Master your tech interviews with 7,500+ real questions from top companies.

Product

  • Questions
  • Learning Tracks
  • Interview Guides
  • Resources
  • Premium
  • For Universities
  • Student Access

Browse

  • By Company
  • By Role
  • By Category
  • Topic Hubs
  • SQL Questions
  • Compare Platforms
  • Discord Community

Support

  • support@prachub.com
  • (916) 541-4762

Legal

  • Privacy Policy
  • Terms of Service
  • About Us

© 2026 PracHub. All rights reserved.