Heaps do lie: debugging a memory leak in vLLM.
The Mistral AI team investigated a memory leak of roughly 400 MB per minute in vLLM when running Mistral Medium 3.1 with graph compilation enabled in P/D disaggregated deployments.
Why it matters: The article documents the full process of localizing the leak layer by layer from pmap and BPFtrace to GDB, which can be applied to similar kernel-level debugging of inference services.