performance
4 articles tagged performance.
-
LLM Key-Value Caches During Autoregressive Generation
How cached attention keys and values eliminate repeated prefix work during generation, and why the speedup consumes substantial memory.
-
Copy-Up in Container Overlay Filesystems
How Linux overlay filesystems combine read-only image layers with a writable container layer and copy files up when a write requires them.
-
Linux TLB Shootdowns and Their Performance Cost
How Linux keeps per-core address-translation caches consistent when page-table entries change, and why that coordination can slow workloads.
-
CPython’s Global Interpreter Lock
How CPython’s GIL protects interpreter state, coordinates thread execution, and lets native extensions run parallel or blocking work safely.