arXiv:2606.18609cs.CV2026-06

通过视觉证据验证,检测并修正医疗视觉语言模型的幻觉问题。

Hallucination Detection and Correction in Medical VLMs via Counter-Evidence Verification

论文配图:Hallucination Detection and Correction in Medical VLMs via Counter-Evidence Verification
图 1 · 摘自论文原文
  • 用双向验证法检查文本陈述与图像区域是否匹配,构建四象限诊断图。
  • 在四个医疗数据集上,检测性能提升3.0%至18.5%,纠正后报告幻觉率下降超11.9%。
  • 无需训练即可插件使用,适合临床辅助诊断场景中的可靠性增强。

视觉语言模型(VLMs)在医疗诊断中的可靠性受幻觉问题挑战。现有方法多聚焦于生成文本与参考数据的事实不一致,但很少验证模型注意力是否真实反映支持文本的视觉证据。为此,我们提出无需训练的即插即用框架——反证验证(CoEV),通过基于证据的事实一致性验证来检测和修正幻觉。CoEV在文本陈述与对应图像区域间进行双向验证,判断每条陈述是否被视觉证据支持,并将其归入四象限诊断图,涵盖文本真实性和视觉根基性组合。CoEV可检测幻觉内容并作为事后修正工具,在不重新训练的情况下修正幻觉。在四个医疗数据集上的实验表明,其检测性能优于现有方法,平均PR-AUC和ROC-AUC分别提升3.0%和3.9%绝对点,特定VQA场景最高提升达18.5%;在幻觉修正方面,微平均F1提升达12.5%,医疗报告生成中幻觉率降低超过11.9%,同时提升医疗VQA准确率。结果证明CoEV能有效实现幻觉的可靠检测与修正,为临床医生提供可信、基于证据的诊断线索。代码将在接受后发布。

原文摘要 · Abstract (English)

Vision-Language models (VLMs) reliability in medical diagnosis is challenged by trust-undermining hallucinations. Existing hallucination detection approaches mainly focus on identifying factual inconsistencies between generated text and reference data. While some studies analyze where models attend in images, they seldom verify whether such attention truly reflects the visual evidence supporting the generated text. To address this gap, we propose Co}unter-Evidence Verification (CoEV), a training-free plug-and-play framework that detects and corrects hallucinations through evidence-based factual consistency verification. CoEV performs bidirectional verification between textual assertions and visual evidence, testing whether each statement is supported by its corresponding evidence region, and assigns each statement into a four-quadrant diagnostic map capturing combinations of text factuality and visual grounding. CoEV detects hallucinated content and serves as a post hoc refinement tool, correcting hallucinations without retraining. Extensive experiments on four medical datasets show that CoEV combats hallucinations in VLMs.For hallucination detection, CoEV consistently outperforms existing methods, improving average PR-AUC and ROC-AUC by 3.0% and 3.9% absolute points respectively, with notable gains of up to 18.5% in specific VQA scenarios. For hallucination correction, it improves Micro-F1 by up to 12.5%, reduces hallucination rates by over 11.9% on medical report generation, and also boosts medical VQA accuracy. These results show that CoEV enables reliable detection and correction of hallucinations, providing clinicians with dependable, evidence-based cues for diagnosis. Code will be released upon acceptance.

医疗AI幻觉检测视觉语言模型证据验证

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。