LLM Digest

Story

arxiv_agent_systems_research · Nov 12, 2026 · paper

Source brief

Small Language Models for Inference-Capability Routing: Effects of Model Capacity and Prompt Optimization on Downstream Quality and Efficiency

arxiv.orgNov 12, 2026
original source linked

In brief

Optional reasoning, retrieval, web search, and tool use can improve large language model responses but incur unnecessary computation when activated indiscriminately. This study investigates whether prompt optimization...

Feed lens

evaluation

Read the original at arxiv.org →Open in live feed Read that day’s brief

Small Language Models for Inference-Capability Routing: Effects of Model Capacity and Prompt Optimization on Downstream Quality and Efficiency

Earlier in this thread 4 items

Smart Routing in Unity AI Gateway: Match frontier quality with 30%+ lower cost per task

C$^2$-Routing: Complementary Cropping and Compression for Efficient Vision-Language Inference

Correct First, Fast Second: What a Local 7B Code Model Can and Cannot Do for GPU Kernel Optimization

Infrathon: Benchmarking Language Agents for Real-World, Long-Horizon AI Infra Optimization