Story
arxiv_cs_ai · Jul 9, 2026 · paper
Source brief
SMetric: Rethink LLM Scheduling for Serving Agents with Balanced Session-centric Scheduling
arxiv.orgJul 9, 2026
original source linked
In brief
LLM scheduling is critical to serving, yet it remains unclear how well existing designs fit agentic serving--with LLM requests issued by agents instead of humans. This shifts the workload in two ways: (1) agents act o...
Feed lens
agentic