This question evaluates a data scientist's competency in causal inference and quasi-experimental analysis for observational telemetry, emphasizing time-series reasoning and handling confounding in product metrics.
Engineers shipped a new Google Meet version intended to reduce call drops. A traditional A/B test was not possible.
Describe analytical methods you would use to determine whether the new version is effective without a traditional experiment.
Assume access to call-level logs (drop outcome, timestamp), version/adoption timestamps, device/network/geo covariates, and that rollout timing varied slightly across users/regions due to normal app-store waves or enterprise policies.
Login required