Explain OS usage gap via trees

Quick Overview

This question evaluates a data scientist's competency in user-behavior modeling, causal inference, telemetry instrumentation, missing-data handling, and segment-based product analysis.

Explain OS usage gap via trees

Role: Data Scientist

Category: Machine Learning

Difficulty: hard

Interview Round: Onsite

Instagram usage is substantially higher among iOS than Android users. 1) Frame this as a supervised learning problem to identify discriminant variables: define target, candidate features (demographics, engagement, acquisition channel, device/app telemetry), and the modeling approach (decision tree vs. random forest). 2) Explain how to detect whether OS is a causal factor vs. a proxy for other variables; outline tests (feature ablation, conditional permutation importance, propensity stratification). 3) Specify additional telemetry you would collect (e.g., cold‑start latency, crash rate, time‑to‑first‑paint, battery drain) and how you’d compare distributions across OS versions. 4) Discuss handling missing values in consumer data: defend the '-1 sentinel' approach vs. model‑based imputation, and when each is appropriate. 5) Given two discovered segments—(a) Argentinians underperforming, (b) Indians <30 overperforming—propose concrete next steps for product/marketing and how to validate impact causally.

Overview: This question evaluates a data scientist's competency in user-behavior modeling, causal inference, telemetry instrumentation, missing-data handling, and segment-based product analysis.

|Home/Machine Learning
Oct 13, 2025
hardData ScientistOnsiteMachine Learning
5
0

iOS vs. Android Usage Gap: Modeling, Causality, Telemetry, Missing Data, and Segmented Actions

Context

You observe that Instagram usage is substantially higher among iOS users than Android users. Assume "usage" refers to per-user weekly minutes spent in app (or a similar engagement proxy). Your task is to: model the drivers of usage, assess whether OS has a causal role, design telemetry comparisons across OS versions, handle missing data appropriately, and propose actions for discovered segments.

Tasks

  1. Supervised learning framing
    • Define a clear prediction target for user-level usage.
    • List candidate features across: demographics, engagement, acquisition channel, and device/app telemetry.
    • Choose and justify a modeling approach (decision tree vs. random forest) for identifying discriminant variables.
  2. Causality check: OS as cause vs. proxy
    • Explain how you would test whether OS is causal vs. a proxy for other factors.
    • Outline procedures for feature ablation, conditional permutation importance, and propensity stratification.
  3. Telemetry collection and cross-OS comparison
    • Specify additional telemetry to collect (e.g., cold-start latency, crash rate, time-to-first-paint, battery drain).
    • Describe how to compare distributions across OS versions robustly.
  4. Missing data handling
    • Defend the "-1 sentinel" approach vs. model-based imputation.
    • Explain when each is appropriate and any guardrails.
  5. Segment actions and validation
    • Given two segments: (a) Argentinians underperforming, (b) Indians <30 overperforming, propose concrete product/marketing next steps.
    • Explain how to validate impact causally.
Loading comments...