Story

Release highlights

• Model Runner V2 is now the default for all models , completing the rollout that began with pooling models . MRV2 also gained CUDA graph memory profiling for...
• New models : Hy4-preview, Tencent's 770B/49B-active MoE with Gated DeepSeek Sparse Attention and native MTP ; Qwen3.8-Flash-Next with BF16/FP8/NVFP4 and MTP...
• Kimi-K3 and DeepSeek V4 performance : fused MXFP4 top-k finalization in the K3 latent tail (about 5% E2E latency, #53152 ), K3 Mamba metadata preparation in...