LLM Digest
Subscribe

Story

vllm_releases · Jun 15, 2026 · release

Source brief

vllm v0.23.0

github.comJun 15, 2026
original source linked

Release highlights

  • DeepSeek-V4 matures across backends : Following its introduction in v0.22.0, DeepSeek-V4 received another large hardening and optimization pass. Its sparse M...
  • Model Runner V2 expands to more dense models : MRv2 is now selected by default for Llama and Mistral dense models in addition to Qwen3. It gained a FlashInfe...
  • Rust frontend grows up : The experimental Rust frontend added a streaming generate endpoint , dynamic LoRA endpoints , /version and /server_info endpoints, a...

Continue reading

Read the original at github.com →Open in live feed

Earlier in this thread 4 items