Story
infoq_ai_ml · May 25, 2026 · news
infoq.comMay 25, 2026
original source linked
In brief
Gemma 4 can be paired with multi-token prediction (MTP) drafters that use speculative decoding to generate multiple tokens in parallel, allowing the model to verify them in a single pass and achieve up to ~3× faster...

Continue reading