Story
arxiv_cs_ai · Sep 30, 2026 · paper
Source brief
Inference Auctions
arxiv.orgSep 30, 2026
original source linked
In brief
When inference demand exceeds available compute capacity, model providers must decide which requests should be served first. Users have different tolerances for delay from an LLM API, but current priority pricing sche...
Feed lens
agent