Why can't we just build one giant, fast memory?
Fast memory is expensive and small. Cheap memory is huge and slow. The memory hierarchy is the compromise every computer makes, and locality is the reason the compromise works.
10 min readUpdated 2026-09-03computer-architecturememory-hierarchylocality