LLM Digest
Subscribe

Story

arxiv_llm_reliability · Nov 19, 2026 · paper

Source brief

Rubric Semantics or Numerical Priors? Auditing Scale-Direction Bias in LLM Judges

arxiv.orgNov 19, 2026
original source linked

In brief

Recent benchmark evaluations increasingly rely on Large Language Models (LLMs) as automatic judges. This paradigm assumes LLMs evaluate based on the rubric's semantic meaning rather than its numeric scale. We question this assumption by introducing semantic faithfulness: the prin

Continue reading

Read the original at arxiv.org →Open in live feedRead that day’s brief

Earlier in this thread 4 items