Story

arxiv_cs_lg ยท Jul 10, 2026 ยท paper

Source brief

A Sovereign, Open-Source Foundation Model for German and English

arxiv.orgJul 10, 2026
original source linked

In brief

We present Soofi S 30B-A3B, a sovereign, open-source Mixture-of-Experts (MoE) hybrid Mamba Transformer foundation model for German and English. Its hybrid design activates only 3B of 30B parameters per token and keeps...

Feed lens
evaluation

Continue reading

Read the original at arxiv.org โ†’Open in live feedRead that dayโ€™s brief

Earlier in this thread 4 items