PracHub
QuestionsPremiumLearningGuidesInterview PrepNEWCoaches
|Home/Analytics & Experimentation/Upstart

Evaluate channels and allocate budget

Last updated: Mar 29, 2026

Quick Overview

This question evaluates competency in marketing analytics and experimentation for a Data Scientist role, covering funnel analysis, conversion and CAC metrics, attribution modeling, response-curve-based budget allocation, and incremental test design using channel-level spend and outcome data.

  • hard
  • Upstart
  • Analytics & Experimentation
  • Data Scientist

Evaluate channels and allocate budget

Company: Upstart

Role: Data Scientist

Category: Analytics & Experimentation

Difficulty: hard

Interview Round: Technical Screen

You are given a marketing-by-channel dataset with daily aggregates: channel, spend, visits, form_starts, form_completes, loan_funded, revenue. Tasks: (1) build a funnel with stage-to-stage conversion rates and CAC at each meaningful milestone; (2) compute ROAS and payback under both last-click and 7-day first-touch attribution (describe how you would re-attribute if you only had raw click/impression logs); (3) recommend next-month budget shifts by channel using a simple response curve (e.g., log or Hill function) and estimate marginal ROAS; (4) design an incrementality test (geo or time-based holdout) to validate your recommendations, including unit of randomization, sample size, contamination risks, and success criteria; (5) flag channels that look effective but likely non-incremental due to retargeting or brand spillovers, and propose diagnostics to detect this. Provide concrete formulas, any assumptions you must make, and how you would communicate the recommendation with risk bounds.

Quick Answer: This question evaluates competency in marketing analytics and experimentation for a Data Scientist role, covering funnel analysis, conversion and CAC metrics, attribution modeling, response-curve-based budget allocation, and incremental test design using channel-level spend and outcome data.

Related Interview Questions

  • Estimate impact without experiments and pick variant - Upstart (easy)
  • Decide to ship a signup experiment - Upstart (hard)
  • Analyze aggregator lender page flows - Upstart (hard)
  • Formulate hypotheses and metrics for video-pin ramp - Upstart (hard)
  • Design Experiment to Measure Airport Surge-Pricing Impact - Upstart (hard)
Upstart logo
Upstart
Oct 13, 2025, 9:49 PM
Data Scientist
Technical Screen
Analytics & Experimentation
9
0

Marketing Analytics Case: Funnel, Attribution, Budget Optimization, and Incrementality

You are given a daily-by-channel dataset with the following columns:

  • date
  • channel
  • spend
  • visits
  • form_starts
  • form_completes
  • loan_funded
  • revenue

Assume each row aggregates that day’s outcomes for a channel. Revenue is recognized at funding (no refunds/chargebacks) and is net of promotions but gross of media cost unless otherwise stated.

Tasks:

  1. Funnel and CAC
    • Build a funnel with stage-to-stage conversion rates: visits → form_starts → form_completes → loan_funded.
    • Compute cost-per-stage ("CAC at each milestone"): cost per visit, per start, per complete, and per funded loan.
  2. ROAS and Payback under Two Attribution Models
    • Compute ROAS and payback using: a) Last-click attribution b) 7-day first-touch attribution
    • Describe how you would re-attribute using only raw click/impression logs if the provided revenue is not already attributed as required.
  3. Next-Month Budget Shifts via Response Curves
    • Fit a simple channel response curve (e.g., logarithmic or Hill function) to link spend to outcomes and estimate marginal ROAS.
    • Recommend how to shift next-month budget by channel based on marginal ROAS.
  4. Incrementality Test Design
    • Propose a geo- or time-based holdout experiment to validate recommendations. Specify unit of randomization, sample size approach, contamination risks, success criteria, and analysis plan.
  5. Diagnose Likely Non-Incremental Channels
    • Flag channels that look effective but may be non-incremental (e.g., retargeting, brand spillovers).
    • Propose diagnostics to detect non-incrementality.

Provide concrete formulas, any assumptions you must make, and how you would communicate the recommendation with risk bounds.

Solution

Show

Comments (0)

Sign in to leave a comment

Loading comments...

Browse More Questions

More Analytics & Experimentation•More Upstart•More Data Scientist•Upstart Data Scientist•Upstart Analytics & Experimentation•Data Scientist Analytics & Experimentation
PracHub

Master your tech interviews with 7,500+ real questions from top companies.

Product

  • Questions
  • Learning Tracks
  • Interview Guides
  • Resources
  • Premium
  • For Universities
  • Student Access

Browse

  • By Company
  • By Role
  • By Category
  • Topic Hubs
  • SQL Questions
  • Compare Platforms
  • Discord Community

Support

  • support@prachub.com
  • (916) 541-4762

Legal

  • Privacy Policy
  • Terms of Service
  • About Us

© 2026 PracHub. All rights reserved.