Story
arxiv_cs_cl ยท Sep 8, 2026 ยท paper
Source brief
Benchmark Scores Are Pipeline-Dependent: A Reliability Audit of Cybersecurity LLM Benchmarks
arxiv.orgSep 8, 2026
original source linked
In brief
Large language model (LLM) benchmarks are often treated as fixed datasets with stable scores, yet their outcomes depend on configurable evaluation pipelines. We audit eight cybersecurity benchmarks across 10 proprieta...
Feed lens
harnessevaluation