Story

arxiv_cs_cl ยท Nov 17, 2026 ยท paper

Source brief

Long-Context Generation Is a Sampling Problem (When You Turn Up the Heat)

arxiv.orgNov 17, 2026
original source linked

In brief

Open-weight language models are widely observed to get worse the longer they generate. Often, attempts to fix this involve more training. At high temperature, The sampler, i.e. the rule that picks the next token out o...

Feed lens
agenticeval

Continue reading

Read the original at arxiv.org โ†’Open in live feedRead that dayโ€™s brief

Earlier in this thread 4 items