PracHub
QuestionsCoachesLearningGuidesInterview Prep
|Home/Machine Learning/Intuit

Decide when to model courier ETA

Last updated: Mar 29, 2026

Quick Overview

This question evaluates a candidate's competency in machine learning product decisions—covering target definition, dispatch-time feature design, offline evaluation metrics, online rollout guardrails, baseline establishment, and consideration of analytics-first alternatives.

  • hard
  • Intuit
  • Machine Learning
  • Data Scientist

Decide when to model courier ETA

Company: Intuit

Role: Data Scientist

Category: Machine Learning

Difficulty: hard

Interview Round: HR Screen

During a project presentation you propose building an ETA model, but stakeholders insist the team is “pure analytics.” Make a case for or against an ML model to predict delivery time from rider pickup to customer drop-off (consistent with the delivery definition). 1) Define the target rigorously (handling cancellations, reassignments, multi-stop batches) and list features available only at dispatch time to avoid leakage. 2) Propose an offline evaluation plan (metrics like MAE and P90 error across distance/time-of-day/platform strata), calibration checks, and out-of-time validation to capture seasonality. 3) Design the online rollout: guardrail metrics (cost/order, SLA breaches), shadow vs. interleaved traffic, fallback heuristics on model outage, and fairness across zones. 4) Detail a simple-but-strong baseline (segment-aware median) and the minimal measurable lift needed to justify productionization given engineering cost. 5) If you decide against ML, prescribe an analytics-first alternative (policy changes, pricing/surge rules) and a decision tree that revisits ML only when predefined trigger thresholds are met.

Quick Answer: This question evaluates a candidate's competency in machine learning product decisions—covering target definition, dispatch-time feature design, offline evaluation metrics, online rollout guardrails, baseline establishment, and consideration of analytics-first alternatives.

Related Interview Questions

  • When should products use AI? - Intuit (easy)
  • Engineer and Impute ZIP Features - Intuit (medium)
  • Handle missing and unavailable predictive features - Intuit (easy)
  • Build a predictive model from TurboTax sample data - Intuit (easy)
|Home/Machine Learning/Intuit

Decide when to model courier ETA

Intuit logo
Intuit
Oct 13, 2025, 9:49 PM
hardData ScientistHR ScreenMachine Learning
6
0
Loading...

Predicting Delivery ETA (Pickup → Drop-off): Case For or Against ML

Context: You’re proposing an ETA model to predict the time from rider pickup to customer drop-off for a last‑mile delivery product. Some stakeholders prefer a “pure analytics” approach. Make a structured case for or against an ML model, including guardrails and alternatives.

1) Target definition and dispatch-time features

  • Define the target rigorously, including how you will handle:
    • Cancellations
    • Rider reassignments
    • Multi-stop batches (sequence position, spillover from earlier stops)
  • List only features available at dispatch time to avoid leakage.

2) Offline evaluation plan

  • Metrics (e.g., MAE, P90 error) across strata (e.g., distance, time-of-day, platform/vehicle type).
  • Calibration checks.
  • Out-of-time validation to capture seasonality.

3) Online rollout plan

  • Guardrail metrics (e.g., cost/order, SLA breaches).
  • Shadow vs. interleaved traffic strategy.
  • Fallback heuristics during model outage.
  • Fairness monitoring across zones.

4) Baseline and threshold for productionization

  • Define a simple-but-strong baseline (e.g., segment-aware median).
  • State the minimal measurable lift needed to justify engineering cost.

5) If deciding against ML

  • Prescribe an analytics-first alternative (e.g., policy changes, pricing/surge rules).
  • Provide a decision tree with triggers that revisit ML when thresholds are met.
Loading comments...

Browse More Questions

More Machine Learning•More Intuit•More Data Scientist•Intuit Data Scientist•Intuit Machine Learning•Data Scientist Machine Learning

Write your answer

Your first approved answer each day earns 20 XP.

Sign in to write your answer.
PracHub

Master your tech interviews with 8,500+ real questions from top companies.

Product

  • Questions
  • Learning Tracks
  • Interview Guides
  • Resources
  • Premium
  • For Universities
  • Student Access

Browse

  • By Company
  • By Role
  • By Category
  • Topic Hubs
  • SQL Questions
  • AI Coding Questions
  • Compare Platforms
  • Discord Community

Support

  • support@prachub.com
  • (916) 541-4762

Legal

  • Privacy Policy
  • Terms of Service
  • About Us

© 2026 PracHub. All rights reserved.