Define Success with Contact Syncing for Growth and Evaluation

Quick Overview

This interview question evaluates metric design, causal reasoning, experiment setup, diagnostics, SQL/statistical checks, and recommendations in a realistic interview setting. A strong answer for Define Success with Contact Syncing for Growth and Evaluation states assumptions, handles edge cases, explains trade-offs, and shows how to validate the result clearly.

Define Success with Contact Syncing for Growth and Evaluation

Company: PayPal

Role: Data Scientist

Category: Analytics & Experimentation

Difficulty: hard

Interview Round: Technical Screen

##### Scenario Leadership wants to use the '% of users with contacts synced' metric to drive growth and evaluate experiments. ##### Question How would you position this percentage metric as a meaningful goal for stakeholders? Describe a framework to set a realistic 2025 target for this metric. During an A/B test the percentage increases but the true-north business metric does not—how would you investigate and respond? If an A/B test is infeasible, what causal-inference approach(es) would you use to estimate the impact of contact syncing? ##### Hints Think metric hierarchy, historical trends, benchmarking, guardrail checks, causal inference methods like DID or propensity matching.

Quick Answer: This interview question evaluates metric design, causal reasoning, experiment setup, diagnostics, SQL/statistical checks, and recommendations in a realistic interview setting. A strong answer for Define Success with Contact Syncing for Growth and Evaluation states assumptions, handles edge cases, explains trade-offs, and shows how to validate the result clearly.

|Home/Analytics & Experimentation/PayPal
PayPal logo
PayPal
Aug 4, 2025, 10:55 AM
hardData ScientistTechnical ScreenAnalytics & Experimentation
5
0

Define Success with Contact Syncing for Growth and Evaluation

Using "% of users with contacts synced" as a growth driver

Context

You are a data scientist at a consumer fintech app with strong network effects in peer-to-peer interactions. Leadership wants to use the metric "% of users with contacts synced" to drive growth and evaluate experiments. Assume:

  • Contacts synced means the user has granted permission and at least one contact has been successfully uploaded and processed within a recent window (for example, last 90 days).
  • The true-north business metric (TN) is a volume/engagement outcome such as active transacting users or payment volume.

Question

  1. How would you position this percentage metric as a meaningful goal for stakeholders?
  2. Describe a framework to set a realistic 2025 target for this metric.
  3. During an A/B test the percentage increases but the true-north business metric does not—how would you investigate and respond?
  4. If an A/B test is infeasible, what causal-inference approach(es) would you use to estimate the impact of contact syncing?

Clarifying Questions to Ask Guidance

  • Clarify the business objective, unit of analysis, time window, exposure definition, and primary metric.
  • State assumptions about instrumentation, randomization, sample size, and data quality.
  • Separate descriptive analysis from causal claims.

What a Strong Answer Covers Guidance

  • A metric framework with primary, guardrail, and diagnostic metrics.
  • A credible analysis or experiment design with clear assumptions and bias checks.
  • SQL/statistical logic for segmentation, variance, confidence, and data validation where relevant.
  • An actionable recommendation that explains trade-offs and next steps.

Follow-up Questions Guidance

  • What sanity checks would you run before trusting the result?
  • How would you handle novelty effects, seasonality, or selection bias?
  • What decision would you make if metrics disagree?
Loading comments...

Browse More Questions

More Analytics & Experimentation•More PayPal•More Data Scientist•PayPal Data Scientist•PayPal Analytics & Experimentation•Data Scientist Analytics & Experimentation