Story
arxiv_cs_lg · Nov 13, 2026 · paper
arxiv.orgNov 13, 2026
original source linked
In brief
Knowledge distillation (KD) is a highly effective paradigm for transferring capabilities from large language models (LLMs) to smaller, more specialized student models. In commercial deployment where frontier models are restricted behind black-box APIs, sequence-level distillation