This question evaluates a Data Scientist's statistical reasoning about confidence levels and experimental trade-offs (false positives/negatives, sample size, time-to-decision, multiple testing and sequential monitoring) as well as applied forecasting competencies for predicting video views from exposure, content and behavioral signals.
You are running an A/B test and must choose the confidence level for hypothesis testing / confidence intervals.
Question: How would you decide between using a 95% confidence level vs a 99% confidence level?
In your answer, address:
You want to predict how many times a video will be watched.
Question: Describe how you would forecast/predict video watch counts (views).
Please cover:
Login required