Airbnb Online Experiences: North-Star Metric and Guardrails for Live Video Activities

Quick Overview

An Airbnb product manager metrics question on judging the success of Online Experiences, the live video activities hosts run for guests anywhere. It tests defining goals for a two-sided marketplace, choosing a north-star metric, building guest and host funnels, and setting guardrails for quality and the core stays business.

Airbnb Online Experiences: North-Star Metric and Guardrails for Live Video Activities

Company: Airbnb

Role: Product Manager

Category: Analytics & Experimentation

Difficulty: medium

Interview Round: Other

Airbnb Online Experiences lets hosts run live activities over video, and guests anywhere in the world book a place in a session. How would you measure whether this product is a success? Lay out what success means for guests, hosts and Airbnb, which metric you would treat as the main one, and what else you would track alongside it. ```hint Two sides, one session Every session needs a host willing to keep offering it and guests happy enough to book again. Decide what a good outcome is for each side before you pick any numbers. ``` ### Clarifying Questions - What stage is the product at: recently launched and still looking for fit, or established and expected to grow revenue? - Should success be judged on Online Experiences alone, or also on its effect on Airbnb's stays and in-person experiences? - Are private bookings for groups, such as families or company teams, in scope as well as individual seats? - Is either side of the marketplace, hosts or guests, the current bottleneck? ### What a Strong Answer Covers - Why the product exists for guests, hosts and Airbnb, and a definition of success tied to the product's stage - One clearly defined north-star metric, with the reasoning for choosing it over alternatives such as bookings or revenue - Funnels and supporting metrics for both guests and hosts, plus marketplace health - Guardrails for quality, safety and the effect on Airbnb's core business - Prioritization of the few metrics that matter most, and how they would be segmented ### Follow-up Questions - Bookings climb but the average rating falls. What do you investigate first? - How would you find out whether Online Experiences leads guests to book stays later, rather than simply attracting people who would have booked anyway? - Travel restrictions lift and bookings drop. Does that mean the product is failing?

Overview: An Airbnb product manager metrics question on judging the success of Online Experiences, the live video activities hosts run for guests anywhere. It tests defining goals for a two-sided marketplace, choosing a north-star metric, building guest and host funnels, and setting guardrails for quality and the core stays business.

Airbnb logo
Airbnb
Aug 8, 2024
mediumProduct ManagerOtherAnalytics & Experimentation
0
0

Airbnb Online Experiences lets hosts run live activities over video, and guests anywhere in the world book a place in a session. How would you measure whether this product is a success?

Lay out what success means for guests, hosts and Airbnb, which metric you would treat as the main one, and what else you would track alongside it.

Clarifying Questions Guidance

  • What stage is the product at: recently launched and still looking for fit, or established and expected to grow revenue?
  • Should success be judged on Online Experiences alone, or also on its effect on Airbnb's stays and in-person experiences?
  • Are private bookings for groups, such as families or company teams, in scope as well as individual seats?
  • Is either side of the marketplace, hosts or guests, the current bottleneck?

What a Strong Answer Covers Guidance

  • Why the product exists for guests, hosts and Airbnb, and a definition of success tied to the product's stage
  • One clearly defined north-star metric, with the reasoning for choosing it over alternatives such as bookings or revenue
  • Funnels and supporting metrics for both guests and hosts, plus marketplace health
  • Guardrails for quality, safety and the effect on Airbnb's core business
  • Prioritization of the few metrics that matter most, and how they would be segmented

Follow-up Questions Guidance

  • Bookings climb but the average rating falls. What do you investigate first?
  • How would you find out whether Online Experiences leads guests to book stays later, rather than simply attracting people who would have booked anyway?
  • Travel restrictions lift and bookings drop. Does that mean the product is failing?