Diagnose Low CTR in an Advertising Campaign Funnel

Quick Overview

Prepare for a product analytics interview by diagnosing below-average advertising CTR from limited campaign-level funnel metrics. The question tests metric interpretation, uncertainty, evidence-versus-hypothesis discipline, and how to plan useful follow-up analysis.

Diagnose Low CTR in an Advertising Campaign Funnel

Company: ByteDance

Role: Data Scientist

Category: Analytics & Experimentation

Difficulty: medium

Interview Round: Technical Screen

# Diagnose Low CTR in an Advertising Campaign Funnel An analysis has flagged several ad campaigns because their click-through rate (CTR) is below the average campaign-level CTR. For each campaign, you currently have only: - campaign dates and daily budget, - total impressions, - total clicks, - total conversions. Using only these fields, explain plausible reasons for weak performance. Separate what the aggregates let you observe from what they do not let you conclude, and state which explanations remain hypotheses. ```hint Start with the funnel Decompose the path from **impression → click → conversion** before proposing causes. A low CTR and a low post-click conversion rate point to different parts of the funnel. ``` ```hint Treat aggregates cautiously Ask whether the comparison is stable across time, audience, placement, device, geography, and creative. An overall average can hide small samples and composition effects. ``` ### Constraints & Assumptions - The available metrics are campaign-level aggregates, not user- or event-level records. - `daily_budget` is a budget cap; it is not confirmed actual spend. - Tracking definitions, attribution windows, and traffic mix have not yet been validated. - The goal is a diagnosis plan, not a claim that one cause has already been proven. ### Clarifying Questions to Ask - How are an impression, click, and conversion defined, deduplicated, and attributed? - Is the benchmark a simple average across campaigns or an impression-weighted aggregate CTR? - How much traffic does each flagged campaign have, and over what dates? - Did targeting, creative, placement, bidding, or tracking change during the campaign? - What decision will this analysis support: pausing spend, changing creative, changing targeting, or launching an experiment? ### What a Strong Answer Covers ```premium-lock What a Strong Answer Covers ``` ### Follow-up Questions 1. How would you compare a campaign with 10 impressions and 0 clicks to one with 100,000 impressions and a slightly below-average CTR? 2. What could cause overall CTR to fall even when CTR improves within every device segment? 3. What additional data would you request before choosing between a creative and targeting explanation? 4. Which guardrail metrics would you monitor if a new creative raises CTR? 5. Design an experiment to distinguish a creative problem from a targeting problem.

Overview: Prepare for a product analytics interview by diagnosing below-average advertising CTR from limited campaign-level funnel metrics. The question tests metric interpretation, uncertainty, evidence-versus-hypothesis discipline, and how to plan useful follow-up analysis.

|Home/Analytics & Experimentation/ByteDance
ByteDance logo
ByteDance
Apr 4, 2026
mediumData ScientistTechnical ScreenAnalytics & Experimentation
3
0

Diagnose Low CTR in an Advertising Campaign Funnel

An analysis has flagged several ad campaigns because their click-through rate (CTR) is below the average campaign-level CTR. For each campaign, you currently have only:

  • campaign dates and daily budget,
  • total impressions,
  • total clicks,
  • total conversions.

Using only these fields, explain plausible reasons for weak performance. Separate what the aggregates let you observe from what they do not let you conclude, and state which explanations remain hypotheses.

Constraints & Assumptions

  • The available metrics are campaign-level aggregates, not user- or event-level records.
  • daily_budget is a budget cap; it is not confirmed actual spend.
  • Tracking definitions, attribution windows, and traffic mix have not yet been validated.
  • The goal is a diagnosis plan, not a claim that one cause has already been proven.

Clarifying Questions to Ask Guidance

  • How are an impression, click, and conversion defined, deduplicated, and attributed?
  • Is the benchmark a simple average across campaigns or an impression-weighted aggregate CTR?
  • How much traffic does each flagged campaign have, and over what dates?
  • Did targeting, creative, placement, bidding, or tracking change during the campaign?
  • What decision will this analysis support: pausing spend, changing creative, changing targeting, or launching an experiment?

What a Strong Answer Covers Premium

Follow-up Questions Guidance

  1. How would you compare a campaign with 10 impressions and 0 clicks to one with 100,000 impressions and a slightly below-average CTR?
  2. What could cause overall CTR to fall even when CTR improves within every device segment?
  3. What additional data would you request before choosing between a creative and targeting explanation?
  4. Which guardrail metrics would you monitor if a new creative raises CTR?
  5. Design an experiment to distinguish a creative problem from a targeting problem.
Loading comments...