Story
arxiv_cs_lg ยท Nov 17, 2026 ยท paper
arxiv.orgNov 17, 2026
original source linked
In brief
Scaling has driven the success of large language models (LLM), with sparse mixture-of-experts (MoE) architectures enabling greater parameter capacity without a proportional increase in computation. At large scales, Mo...