Story
arxiv_cs_lg · Oct 29, 2026 · paper
Source brief
Read, Allocate, Route: Role-Coupled Tokenization for Pixel-Space Generative Transformers
arxiv.orgOct 29, 2026
original source linked
In brief
Pixel-space generative Transformers typically use one token per image patch, so capturing finer detail requires more tokens and makes global attention increasingly expensive. We observe that finer detail does not necessarily require more global communication: low-frequency struct