Story

Release highlights

• New models : DeepSeek-V4.1-Flash ( #56214 , #56228 , #56208 ) with the whole KV stored in MXFP8 through the FlashMLA V4.1 record on SM100 , DeepGEMM Mega-mHC...
• Fast Start : a persistent per-GPU weight-cache daemon holds post-quantized, TP-sharded weights in GPU memory so restarting engines map them over CUDA IPC wit...
• Watermarking : Gumbel-max watermarked generation and detection with a keyed PRF, per-request opt-out and an example detection endpoint ; dual-key Gumbel-max...