arXiv:2605.04180cs.CLcs.AI2026-05

提出医学幻觉检测新基准,发现证据正确性比幻觉隐蔽性更关键。

MedFabric: Gold Evidence Hides the Difficulty of Word-Level Medical Fabrication Detection

论文配图:MedFabric: Gold Evidence Hides the Difficulty of Word-Level Medical Fabrication Detection
图 1 · 摘自论文原文
  • 构建646个词级医学幻觉样本,每条与同源真实文本高度相似
  • 无金标准证据时检测器性能仅35%,低于无证据基线
  • 引入置信度门控可将准确率从61%提升至74%,适合临床部署

大语言模型在医学领域常生成流畅但错误的事实性陈述,可靠幻觉检测是临床应用的前提。现有评估存在两大缺陷:作者风格捷径(人类真值与模型幻觉配对,使检测器依赖写作风格而非事实)和测试时提供金标准证据。为此我们构建MedFabric基准,要求消除风格捷径、每个幻觉均对应真实可检索的原文段落,并覆盖实际部署中的证据质量范围。该基准包含646个词级医学幻觉,每个与同源真值共享作者且表面形式几乎相同(中位ROUGE-L 0.95)。在该基准上任务仍未解决:专家临床医生仅达53.3%宏平均F1,所有检测器家族在无金标准时均未超过60%。核心发现是检测效果取决于证据正确性而非幻觉隐蔽性——强模型在正确证据下得分91%,但在错误证据下降至35%,低于其自身无证据基线,此模式在两个基准、两种模型规模上均成立。该失败可被纠正:引入检索置信度门控后,宏平均F1从61%提升至74%。我们公开了MedFabric、全部代码与基线模型。

原文摘要 · Abstract (English)

Large language models fabricate in medicine, producing fluent statements that are factually wrong, so reliable fabrication detection is a prerequisite for clinical deployment. Reported progress on this task is inflated by two evaluation artifacts: an authorship-style shortcut, where human-written ground truths are paired with LLM-written hallucinations so detectors key on writing style rather than facts, and the provision of gold evidence at test time. A benchmark that tests factual reasoning must therefore remove the style shortcut, ground every fabrication in a real retrievable passage, and score detectors across the range of evidence quality faced in deployment. We build MedFabric to these requirements, a benchmark of 646 word-level medical fabrications, each paired with a ground truth that shares its LLM authorship and near-identical surface form (median ROUGE-L 0.95). On MedFabric the task is unsolved: expert clinicians reach only 53.3% macro F1 and no detector family clears about 60% without gold evidence. Our central finding is that detection is governed by evidence correctness rather than fabrication subtlety, since a strong LLM scores 91% with the gold passage but falls to 35%, below its own no-evidence baseline, under a wrong one, a pattern that holds on two benchmarks at two model scales. The failure is actionable: a retrieval-confidence gate that abstains on low-confidence evidence raises macro F1 from 61% to 74%, and we release MedFabric, all code, and every baseline.

医学生成幻觉检测检索增强

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。