LLM Digest
Subscribe

Story

vllm_releases · Nov 18, 2026 · release

Source brief

vllm v0.34.0

github.comNov 18, 2026
original source linked

Release highlights

  • 10 new models (Mistral Large 4, MiniMax-M3.1-Flash, Nemotron-3.5-Transcribe, and more!)
  • Extensible KV cache is on by default: vLLM sizes the KV cache from memory actually free after warmup, so most models get a bigger cache and more throughput -...
  • Model Runner V1 is gone. Model Runner V2 is now the only GPU runner
Feed lens
agenticcodex

Continue reading

Read the original at github.com →Open in live feedRead that day’s brief

Earlier in this thread 4 items