Story
arxiv_cs_lg ยท Nov 13, 2026 ยท paper
arxiv.orgNov 13, 2026
original source linked
In brief
Agent sessions may involve frequent context edits, which effectively invalidate cached KV state and force requests to wait for re-prefill before decoding. We present Callo, a disaggregated serving system that leverage...
Feed lens
agenteval