Story
arxiv_cs_lg · Nov 16, 2026 · paper
arxiv.orgNov 16, 2026
original source linked
In brief
In Joint-Embedding Predictive Architectures (JEPAs), a well-constrained projector output does not by itself prevent representation collapse. We find that, from initialization, the encoder representation is dominated by a component shared by different inputs. A batch-normalized pr