Story

arxiv_cs_ai ยท Sep 16, 2026 ยท paper

Source brief

Bad Genius: Counterfactual-Guided Harness Evolution Beyond Task-Specific Shortcuts

arxiv.orgSep 16, 2026
original source linked

In brief

Reliable agent evaluation is complicated by automatic harness optimization, which repeatedly uses a released benchmark $B_{\mathrm{rel}}$ to guide a Proposer that edits prompts, memory, retrieval, tools, and control c...

Feed lens
agentharnessevaluation

Continue reading

Read the original at arxiv.org โ†’Open in live feedRead that dayโ€™s brief

Earlier in this thread 4 items