Story

arxiv_cs_ai ยท Nov 7, 2026 ยท paper

Source brief

D-REAL: Acceptance-Length Optimization with Unbiased Gradients for Speculative Decoding

arxiv.orgNov 7, 2026
original source linked

In brief

Speculative decoding efficiency depends on the number of consecutively accepted draft tokens, yet token-level training objectives do not directly optimize this quantity. We introduce D-REAL (Drafter Reinforcement of E...

Feed lens
eval

Continue reading

Read the original at arxiv.org โ†’Open in live feedRead that dayโ€™s brief

Earlier in this thread 4 items