LLM Digest
Subscribe

Story

arxiv_cs_lg · Nov 16, 2026 · paper

Source brief

SADL: On the Demand-Supply Geometry of Representation Collapse

arxiv.orgNov 16, 2026
original source linked

In brief

In Joint-Embedding Predictive Architectures (JEPAs), a well-constrained projector output does not by itself prevent representation collapse. We find that, from initialization, the encoder representation is dominated by a component shared by different inputs. A batch-normalized pr

Continue reading

Read the original at arxiv.org →Open in live feedRead that day’s brief

Earlier in this thread 4 items