Story
arxiv_llm_reliability · Nov 17, 2026 · paper
arxiv.orgNov 17, 2026
original source linked
In brief
In vision-language models (VLMs), a few sink tokens attract a disproportionate share of attention. While previous studies have examined why these tokens attract attention, we investigate how the sink-key direction affects attention to image and question tokens. Across four probed