Cache Microarchitecture

it not long before improvements in chip manufacturing allowed more circuitry placed on die, , designers started looking ways use it. 1 of common add ever-increasing amount of cache memory on-die. cache fast memory, memory can accessed in few cycles opposed many needed talk main memory. cpu includes cache controller automates reading , writing cache, if data in cache appears , whereas if not processor stalled while cache controller reads in.

risc designs started adding cache in mid-to-late 1980s, 4 kb in total. number grew on time, , typical cpus have @ least 512 kb, while more powerful cpus come 1 or 2 or 4, 6, 8 or 12 mb, organized in multiple levels of memory hierarchy. speaking, more cache means more performance, due reduced stalling.

caches , pipelines perfect match each other. previously, didn t make sense build pipeline run faster access latency of off-chip memory. using on-chip cache memory instead, meant pipeline run @ speed of cache access latency, smaller length of time. allowed operating frequencies of processors increase @ faster rate of off-chip memory.