Story
arxiv_cs_lg · Nov 13, 2026 · paper
arxiv.orgNov 13, 2026
original source linked
In brief
Mixture-of-Experts (MoE) architectures activate only a subset of experts for each token, allowing large language models (LLMs) to scale parameter capacity without a proportional increase in computation per token. However, intermediate data movement and uneven expert loads limit t
Continues in