Design an Evaluation for Jogging Route Recommendations in Maps

Objective

Design an A/B test and evaluation framework for recommending optimal jogging routes. Your design should include:

1. Primary metric selection (choose one) and precise definition.
2. Secondary metrics and how to compute them (e.g., route adherence, repeat jogs in 7 days, safety incidents, time variance vs a baseline, battery drain).
3. Eligibility and triggering logic for counting an exposure.
4. Experimental unit, randomization/assignment, and contamination prevention (multi-device, social sharing).
5. Guardrail metrics and thresholds (e.g., app crash rate, navigation reroutes, ETA accuracy).
6. Power/MDE analysis: For a baseline completion rate of 40% and an expected +3 percentage point lift, compute the minimum sample size with 80% power and α = 0.05. State your formulas and note any clustering/novelty adjustments.
7. A ramp plan, geographic stratification approach, novelty-decay checks, and a rollback criterion.

Provided Constraints

• Eligibility/triggering: Expose the suggestion only when the user has opted into fitness mode, location accuracy < 30 m, speed in [1, 4] m/s, and a route suggestion is actually shown.
• Consider how to prevent contamination across devices and via social sharing.