Story
arxiv_cs_lg ยท Jul 10, 2026 ยท paper
arxiv.orgJul 10, 2026
original source linked
In brief
We present Soofi S 30B-A3B, a sovereign, open-source Mixture-of-Experts (MoE) hybrid Mamba Transformer foundation model for German and English. Its hybrid design activates only 3B of 30B parameters per token and keeps...
Feed lens
evaluation