Design MapReduce for schedule aggregation
MapReduce Design: Common Availability From Busy Intervals
Context
You are given large-scale calendar data: each user has 0 or more busy intervals during the day. For a set of specified groups (each group is a set of user IDs), compute the common available time slots whose duration is at least d minutes. Assume all timestamps are normalized to UTC and intervals are half-open [start, end).
Input datasets:
-
Busy intervals: records (user_id, start_ts, end_ts)
-
Group membership: records (group_id, user_id)
-
Query parameter: minimum duration d (minutes)
Output:
-
For each (group_id, calendar_day), the list of common free intervals of length ≥ d.
Requirements
-
Define the Map outputs (keys/values), partitioning, and Reduce logic.
-
Explain how you discretize time (or avoid discretization) and the trade-offs.
-
Describe how you mitigate data skew (e.g., very large groups, rush-hour hotspots).
-
Explain how you validate correctness and performance at scale.
Constraints & Assumptions
-
Preserve the scope, facts, inputs, and requested outputs from the prompt above.
-
If the prompt leaves a detail unspecified, state a reasonable assumption before relying on it.
-
Keep the answer interview-ready: concise enough to present, but concrete enough to implement or evaluate.
Clarifying Questions to Ask
-
Clarify users, core use cases, read/write patterns, scale, latency, availability, and data retention.
-
State explicit assumptions before making sizing or architecture decisions.
-
Prioritize the functional path first, then address reliability, security, observability, and rollout.
What a Strong Answer Covers
-
A scoped requirements summary with concrete non-goals and success metrics.
-
API, data model, architecture, consistency, capacity, and operations.
-
Reasoned trade-offs among simple and scalable designs, including bottlenecks and failure modes.
-
A validation, monitoring, migration, and launch plan appropriate for the risk level.
Follow-up Questions
-
What breaks first at 10x traffic or data volume?
-
How would you degrade gracefully during dependency failures?
-
What metrics and alerts would prove the design is healthy after launch?