LLM Digest

Story

arxiv_cs_cl · Nov 6, 2026 · paper

Source brief

Query-Guided RoPE Modulation for Lost-in-the-Middle Mitigation in Long-Context LLMs

arxiv.orgNov 6, 2026
original source linked

In brief

Long-context language models often neglect information in the middle of the input, a phenomenon known as "lost-in-the-middle". Part of this gap may stem from the long-range decay of rotary position embedding (RoPE), which weakens the positional signal between distant tokens. Exis

Feed lens

eval

Read the original at arxiv.org →Open in live feed Read that day’s brief

Query-Guided RoPE Modulation for Lost-in-the-Middle Mitigation in Long-Context LLMs

Earlier in this thread 4 items

DAMI: Dual-Axis Memory Initialization for Enhanced Long-Context Retrieval in Gated Linear Attention

Retrieval as Traversal: Value-Indexed Memory for Stateful Long-Context Agents

Hallucinations of Large Language Models in Cross-Language Code Translation: Phenomena and Mitigation

ByteDance researchers identify cause of inconsistent long-context retrieval in DeepSeek models