When More Data Hurts: Privacy, Survey Fatigue and Analysis Risks of Over-Collection
Company: Invoice Simple
Role: Product Manager
Category: Analytics & Experimentation
Difficulty: medium
Interview Round: Other
Why can gathering more user data, or more survey responses, than a product decision needs become a problem? Explain the risks on both fronts.
```hint Ask who pays for each extra data point
For both halves, consider the cost to users, to the company and to the quality of the analysis. Then ask whether extra survey responses hurt by themselves or through how they are obtained and used.
```
### Clarifying Questions
- Does "user data" mean behavioral event logs from the product, personal details users enter, or both?
- Should "too many survey responses" be read as surveying more users than the sample size requires, or as surveying the same users too often?
- Which privacy regimes apply to our users, for example GDPR in Europe or CCPA in California?
### What a Strong Answer Covers
- Privacy, legal and security exposure created by data that has no defined purpose
- Effects on user trust, survey fatigue and future response rates
- Analytical costs: diminishing precision gains, trivial but "significant" differences, false findings from over-slicing, and the fact that volume does not cure bias
- Operational cost of storing, maintaining and governing data nobody uses
- Practices that keep collection proportionate, balanced against the opposite risk of collecting too little
### Follow-up Questions
- An engineer argues the team should log everything now because nobody knows which questions will matter later. How do you respond?
- With a very large survey sample, nearly every difference between segments comes out statistically significant. How do you decide which ones matter?
- How would you set a policy on how often any single user can be surveyed?
Overview: A product manager interview question on the downsides of gathering far more user data or survey responses than a decision needs. It tests understanding of privacy and security exposure, user trust and survey fatigue, the limits of large samples for precision and bias, and practices that keep data collection tied to a clear purpose.