Story
arxiv_llm_reliability · Nov 19, 2026 · paper
arxiv.orgNov 19, 2026
original source linked
In brief
Recent benchmark evaluations increasingly rely on Large Language Models (LLMs) as automatic judges. This paradigm assumes LLMs evaluate based on the rubric's semantic meaning rather than its numeric scale. We question this assumption by introducing semantic faithfulness: the prin