Topic: KV Cache

All essays filed under "KV Cache".

• What LLMs Do at Inference: A Deep Dive Under the Hood

  Updated: 9 Jan, 2026

  A step-by-step, reference-backed explanation of what happens during LLM inference: tokenization, embeddings, prefill & decode phases, KV caching, decoding strategies, bottlenecks and optimizations like quantization, FlashAttention and speculative decoding.

• KV Cache Explained - A Deep Dive into Transformer Optimization

  Updated: 9 Jan, 2026

  A Deep Dive into Transformer Optimization