Story
arxiv_cs_lg · Nov 13, 2026 · paper
arxiv.orgNov 13, 2026
original source linked
In brief
Barron et al. (2026) recently identified numerical issues in the softmax and soft cross-entropy loss. We show that similar issues are present in standard divergence operations between categorical distributions. This includes the forward and reverse Kullback-Leibler (KL) divergenc