arXiv:2606.03305cs.AI2026-06中稿 · KDD被引 1

现有检测方法在真实场景下可靠性下降,因数据分布变化和规模差异导致误判。

The Reliability Gap in Benchmark Auditing: Distribution Shift and Scale as Failure Modes of Contamination Detection

论文配图:The Reliability Gap in Benchmark Auditing: Distribution Shift and Scale as Failure Modes of Contamination Detection
图 1 · 摘自论文原文
  • 测试三种统计检测方法在分布偏移与小规模基准下的表现
  • 335次评估中仅201次结果正确,多数方法出现误报或漏检
  • 适用于模型审计人员,提醒警惕数据污染检测的局限性

基准数据污染(即评估样本出现在模型训练数据中)威胁大语言模型评估的有效性。尽管已有统计工具用于检测训练数据成员身份,但其验证几乎仅限于理想化的学术环境:大规模、同质的预训练语料库和透明的单阶段训练流程。这些方法在真实审计场景中的可靠性仍不明确。本文识别出两个被忽视的失效模式:分布偏移(当可疑集与验证集违反独立同分布假设时)和规模限制(因基准数据远小于预训练语料库)。我们系统评估了三种主流方法——LLM Dataset Inference、Post-Hoc Dataset Inference 和 CoDeC——在25个来自多个模型族(包括Pythia、OLMo 2及专精文化与医疗领域的LLM)且规模达270亿参数的模型上的表现。进一步扩展至前沿工业模型。在总计335次评估中,仅有201次获得正确结果。其中,LLM Dataset Inference 在分布偏移下产生假阳性;Post-Hoc Dataset Inference 在基准规模下功率不足;CoDeC 仅提供粗粒度的来源信号,不足以验证单个基准子集。结果揭示了控制验证与实际基准审计之间的系统性可靠性差距,表明当前统计检测尚无法替代透明的数据溯源。论文已开源基准供后续研究。

原文摘要 · Abstract (English)

Benchmark contamination, where evaluation examples appear in a model's training data, threatens the validity of LLM assessment. Statistical tools for detecting training-data membership exist, but have been validated almost exclusively in controlled academic regimes: large, homogeneous pre-training corpora and transparent, single-stage training pipelines. Whether these methods remain reliable in realistic auditing scenarios remains unclear. We identify two under-studied failure modes: distribution shift, which arises when suspect and validation sets violate the IID assumption, and scale constraints, which arise because benchmarks are orders of magnitude smaller than pre-training corpora. We systematically evaluate three leading paradigms, LLM Dataset Inference, Post-Hoc Dataset Inference, and CoDeC, across 25 models from multiple families (including Pythia, OLMo 2, and specialised cultural and medical LLMs) and scales (up to 27B). We then further extend our analysis to frontier industry models. Across 335 evaluations, only 201 yield correct outcomes. LLM Dataset Inference results in false positives under distribution shift, Post-Hoc Dataset Inference is underpowered at benchmark scale, and CoDeC provides only coarse provenance signals that are insufficient to verify individual benchmark splits. Our results reveal a systematic reliability gap between controlled validation and practical benchmark auditing, and show that statistical detection cannot yet replace transparent data provenance. We open-source our benchmark for further research.

数据污染模型审计统计检测

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。