PracHub
QuestionsPremiumLearningGuidesInterview PrepNEWCoaches
|Home/Statistics & Math/Thumbtack

Test regional response-rate differences rigorously

Last updated: Mar 29, 2026

Quick Overview

This question evaluates applied statistical modeling and causal-inference competencies, including adjustment for confounding, analysis of proportion/count outcomes, variance estimation under clustering, multiple-comparison control, diagnostic detection of Simpson’s paradox, and clear effect-size reporting; it is categorized under Statistics & Math and emphasizes practical application with necessary conceptual understanding. Such problems are commonly asked to assess the ability to justify and interpret comparative analyses that account for covariate mix, temporal structure, and multiple-testing concerns, and this summary is in English.

  • medium
  • Thumbtack
  • Statistics & Math
  • Data Scientist

Test regional response-rate differences rigorously

Company: Thumbtack

Role: Data Scientist

Category: Statistics & Math

Difficulty: medium

Interview Round: Onsite

Using the same job-level data (job_category, region, invitations_sent, provider_responses, created_at), determine whether response rates differ by region after adjusting for job_category mix and time. Specify and justify a statistical approach (e.g., logistic regression with response as successes/tries, or a mixed-effects model with region random effects). Include: (1) model formula, link function, and any fixed effects (job_category, month) and interactions; (2) how you will cluster or regularize standard errors; (3) a multiple-comparison strategy across many regions (e.g., Holm–Bonferroni or Benjamini–Hochberg on region coefficients); (4) a diagnostic to detect Simpson’s paradox driven by job_category mix; and (5) how you would report effect sizes and practical significance, not just p-values.

Quick Answer: This question evaluates applied statistical modeling and causal-inference competencies, including adjustment for confounding, analysis of proportion/count outcomes, variance estimation under clustering, multiple-comparison control, diagnostic detection of Simpson’s paradox, and clear effect-size reporting; it is categorized under Statistics & Math and emphasizes practical application with necessary conceptual understanding. Such problems are commonly asked to assess the ability to justify and interpret comparative analyses that account for covariate mix, temporal structure, and multiple-testing concerns, and this summary is in English.

Related Interview Questions

  • Design cross-validation; explain bias–variance - Thumbtack (Medium)
  • Optimize red-ball draw probability, prove optimality - Thumbtack (medium)
Thumbtack logo
Thumbtack
Oct 13, 2025, 9:49 PM
Data Scientist
Onsite
Statistics & Math
4
0

Goal

Assess whether provider response rates differ by region after adjusting for job category mix and time.

Data

You have job-level observations with the following fields:

  • job_category (categorical)
  • region (categorical)
  • invitations_sent (integer ≥ 0)
  • provider_responses (integer ≥ 0, ≤ invitations_sent)
  • created_at (timestamp)

Interpretation: For each job, invitations_sent providers were invited and provider_responses of them responded.

Task

Propose and justify a statistical approach to estimate regional differences in response rates while controlling for job_category and time. Include:

  1. Model specification: family/link, explicit formula, fixed effects for job_category and time (e.g., month), and any interactions you recommend.
  2. How you will compute or regularize standard errors (e.g., clustering/robust variance).
  3. A multiple-comparison strategy across many regions (e.g., Holm–Bonferroni or Benjamini–Hochberg on region effects).
  4. A diagnostic for Simpson’s paradox driven by job_category mix.
  5. How you will report effect sizes and practical significance, not just p-values.

State any minimal assumptions you need (e.g., how you define time buckets from created_at).

Solution

Show

Comments (0)

Sign in to leave a comment

Loading comments...

Browse More Questions

More Statistics & Math•More Thumbtack•More Data Scientist•Thumbtack Data Scientist•Thumbtack Statistics & Math•Data Scientist Statistics & Math
PracHub

Master your tech interviews with 7,500+ real questions from top companies.

Product

  • Questions
  • Learning Tracks
  • Interview Guides
  • Resources
  • Premium
  • For Universities
  • Student Access

Browse

  • By Company
  • By Role
  • By Category
  • Topic Hubs
  • SQL Questions
  • Compare Platforms
  • Discord Community

Support

  • support@prachub.com
  • (916) 541-4762

Legal

  • Privacy Policy
  • Terms of Service
  • About Us

© 2026 PracHub. All rights reserved.