Scalability

Scalability is about adding capacity where a growing workload needs it. Compare vertical and horizontal scaling, then connect load balancing, caching, replication, and sharding to the limits they address. Each choice brings costs and operating work as well as capacity.

What is scalability?

Scalability is a system’s ability to handle a growing workload while meeting its agreed latency, throughput, and reliability targets, usually by adding resources or changing how work is distributed. For a search engine, the workload might grow in concurrent queries, index size, or both. Specify which dimension is growing and which target must hold.

Consider another example where early Twitter often crashed, displaying the “fail whale.” This was primarily a scalability issue. The system could not handle rapid user growth and write-heavy traffic. Scalability allows a system to absorb traffic spikes without excessive latency or downtime. Without it, response times increase, and outages become more likely.