PracHub
QuestionsPremiumLearningGuidesCheatsheetNEWCoaches
|Home/Analytics & Experimentation/TikTok

Analyze promo anomaly and design risk guardrails

Last updated: Mar 29, 2026

Quick Overview

This question evaluates a candidate's ability to diagnose promotional anomalies, distinguish coordinated abuse from organic virality, design real-time approve/hold/reject decisioning with cost trade-offs, and specify experiment and monitoring plans, testing competencies in fraud analytics, operational risk modeling, and experimentation.

  • Medium
  • TikTok
  • Analytics & Experimentation
  • Data Scientist

Analyze promo anomaly and design risk guardrails

Company: TikTok

Role: Data Scientist

Category: Analytics & Experimentation

Difficulty: Medium

Interview Round: HR Screen

During a 2‑hour 11.11 flash sale (11:00–13:00), an account A123 places 80 orders in 10 minutes using 12 payment cards across 5 device_ids; 9 orders share the same shipping address with 4 other accounts; the baseline for similar users is 2 orders/day. The real‑time approval system targets a 0.3% chargeback rate and a 2% manual‑review rate. Part A — Diagnose: (1) What hypotheses besides fraud could explain this pattern? (2) What immediate data would you pull in the next 15 minutes (specific features and joins) to separate coordinated abuse from organic virality? (3) Propose a real‑time decisioning strategy (approve/hold/reject): specify concrete rules or model thresholds and estimate business impact using a cost matrix where FP = $30 lost GMV, FN = $120 fraud loss, review cost = $1/order. (4) Quantify GMV and loss impact if we hold 50% of A123‑like traffic for 30 minutes versus rejecting outright; state assumptions. Part B — Design safer promos: (5) Redesign the promotion to reduce abuse (coupon structure, per‑user caps, velocity limits, payment‑risk tiers, address trust scores, bot mitigation), and define guardrail metrics with alert thresholds. (6) Outline an experiment and monitoring plan (holdout or geo‑split), success/stop criteria, and explicit rollback conditions.

Quick Answer: This question evaluates a candidate's ability to diagnose promotional anomalies, distinguish coordinated abuse from organic virality, design real-time approve/hold/reject decisioning with cost trade-offs, and specify experiment and monitoring plans, testing competencies in fraud analytics, operational risk modeling, and experimentation.

Related Interview Questions

  • Define Ultra success metrics and detect suspicious transactions - TikTok (easy)
  • Plan DS approach for biker delivery project - TikTok (easy)
  • Define and critique a user activity metric - TikTok (easy)
  • Design and decompose Trust & Safety risk metrics - TikTok (easy)
  • Design an interference-robust A/B test for monetization - TikTok (hard)
TikTok logo
TikTok
Oct 13, 2025, 9:49 PM
Data Scientist
HR Screen
Analytics & Experimentation
5
0

During a 2‑hour 11.11 flash sale (11:00–13:00), an account A123 places 80 orders in 10 minutes using 12 payment cards across 5 device_ids; 9 orders share the same shipping address with 4 other accounts; the baseline for similar users is 2 orders/day. The real‑time approval system targets a 0.3% chargeback rate and a 2% manual‑review rate. Part A — Diagnose: (1) What hypotheses besides fraud could explain this pattern? (2) What immediate data would you pull in the next 15 minutes (specific features and joins) to separate coordinated abuse from organic virality? (3) Propose a real‑time decisioning strategy (approve/hold/reject): specify concrete rules or model thresholds and estimate business impact using a cost matrix where FP = 30lostGMV,FN=30 lost GMV, FN = 30lostGMV,FN=120 fraud loss, review cost = $1/order. (4) Quantify GMV and loss impact if we hold 50% of A123‑like traffic for 30 minutes versus rejecting outright; state assumptions. Part B — Design safer promos: (5) Redesign the promotion to reduce abuse (coupon structure, per‑user caps, velocity limits, payment‑risk tiers, address trust scores, bot mitigation), and define guardrail metrics with alert thresholds. (6) Outline an experiment and monitoring plan (holdout or geo‑split), success/stop criteria, and explicit rollback conditions.

Comments (0)

Sign in to leave a comment

Loading comments...

Browse More Questions

More Analytics & Experimentation•More TikTok•More Data Scientist•TikTok Data Scientist•TikTok Analytics & Experimentation•Data Scientist Analytics & Experimentation
PracHub

Master your tech interviews with 7,500+ real questions from top companies.

Product

  • Questions
  • Learning Tracks
  • Interview Guides
  • Resources
  • Premium
  • For Universities
  • Student Access

Browse

  • By Company
  • By Role
  • By Category
  • Topic Hubs
  • SQL Questions
  • Compare Platforms
  • Discord Community

Support

  • support@prachub.com
  • (916) 541-4762

Legal

  • Privacy Policy
  • Terms of Service
  • About Us

© 2026 PracHub. All rights reserved.