Describe a time quantitative metrics and direct customer feedback pointed in different directions. How did you test the apparent conflict, decide which evidence to trust for the decision, and communicate the resulting tradeoff? ### Constraints & Assumptions - Use an example with a real product or operational decision. - Treat neither the metric nor the feedback as automatically authoritative. - Separate observed evidence from your interpretation of it. ### Clarifying Questions to Ask - Were the metrics causal experiment results, observational data, or aggregate dashboards? - How were customers selected, and could the feedback sample be biased? - Did the two sources measure the same population, time horizon, and outcome? ### What a Strong Answer Covers - Checks for instrumentation, segmentation, lag, survivorship, and sampling bias. - A hypothesis explaining how both signals could be true for different users or outcomes. - A targeted analysis, interview set, or experiment that reduces the important uncertainty. - A decision rule tied to customer value and risk, not simply the loudest stakeholder. - Transparent communication of confidence, limitations, and follow-up monitoring. ### Follow-up Questions - What result would have caused you to reverse the decision? - How did you include customers whose behavior was missing from the dashboard? - Which leading and lagging indicators did you monitor afterward?