LLM Digest

Story

arxiv_cs_lg · Sep 9, 2026 · paper

Source brief

A Later Test Set Is Not a New Domain: Pretraining Familiarity Survives a Contamination-Free Hold-Out

arxiv.orgSep 9, 2026
original source linked

In brief

Time-series foundation models are evaluated almost exclusively on public archives that predate them, so a strong score cannot be separated from having seen the test set during pretraining. The obvious remedy is a hold...

Feed lens

eval

Read the original at arxiv.org →Open in live feed Read that day’s brief

A Later Test Set Is Not a New Domain: Pretraining Familiarity Survives a Contamination-Free Hold-Out

Earlier in this thread 4 items

Teaching a local LLM to reason about a new domain through continued pretraining

Scale-Aware Pretraining of Time Series Foundation Models via Multi-Patch Token Alignment and Hybrid Masking

Label-Decoupled Style Augmentation for Domain Generalization in Multi-Label Remote Sensing Scene Classification

Show HN: Rubric – test what your LLM agent did, not just what it said