Determine Metrics to Evaluate Notification Impact on Users

Q: Determine Metrics to Evaluate Notification Impact on Users

This question evaluates a data scientist's competency in defining and interpreting engagement, retention, and downstream metrics and in designing experiments to measure the impact of notification systems; category/domain: Analytics & Experimentation for data science roles.

Q: How do I approach Analytics & Experimentation interview questions?

Analytics & Experimentation questions require understanding of core concepts and practice. PracHub provides solutions with explanations to help you master analytics & experimentation interviews.

Question

Evaluating Push Notifications and a New Event-Based Notification

Context

You are a data scientist at Facebook working on push notifications. Facebook sends many notification types and is considering launching a new notification that alerts a user when a friend plans to attend an event.

Questions

Which data and metrics would you use to determine whether an existing notification type is helpful or harmful to users?
What analyses or experiments would you run to decide whether to launch the new event-based notification ("Your friend plans to attend <Event> ")?

Hints: Consider funnel metrics, user experience trade-offs, A/B tests, downstream engagement, and churn.

Determine Metrics to Evaluate Notification Impact on Users

Evaluating Push Notifications and a New Event-Based Notification

Context

Questions

Solution

Comments (0)