让医学视觉语言模型在不确定时自动缩放局部重判,提升诊断可靠性。
EVADE: Evidence-Verified Agentic Diagnosis with Escape

- 通过多视图一致性验证避免自检幻觉,不依赖重新推理
- 在多个数据集上使校准误差降低45%,同时保持准确率
- 适合需要高可信诊断的医疗AI部署场景
医学视觉语言模型虽有高准确率,但存在过度自信、测试时推理收益低、信任度难以校准等问题。本文提出EVADE(证据验证的代理诊断与逃逸机制),一种无需训练的推理方法,可增强单个冻结视觉语言模型的安全性。当模型不确定时,它会定位最具有诊断意义的区域,基于放大视图重新作答;仅当整体图像与放大视图结果一致时才输出答案,否则选择放弃。为解决单模型自检中的验证幻觉问题,核心思想是跨不同图像视图验证门控一致性,而非重复阅读模型自身文本。在VQA-RAD、SLAKE和PathVQA数据集上使用Qwen2.5-VL-7B的实验表明,EVADE是唯一同时提升校准效果与选择性风险控制且维持准确率的方法,相比零样本推理,预期校准误差(ECE)最高降低45%。思维链、自我一致性与自我验证均至少在一个维度上失效。定点分析显示,模型自主提出的区域比中心或随机裁剪更优,但70亿参数模型无法利用该定位修正答案。因此,可靠性提升主要来自一致性门控与校准后的弃权机制。
原文摘要 · Abstract (English)
Medical vision-language models (VLMs) can achieve high accuracy but remain unreliable: they are systematically overconfident, benefit little from test-time reasoning, and lack the ability to reliably calibrate trust in their own responses. We introduce EVADE (Evidence-Verified Agentic Diagnosis with Escape), an inferential, non-training method that enhances the safety of deploying a single frozen VLM. EVADE responds and, when uncertain, localises the region most diagnostically relevant, re-answers on a zoomed view, and commits only when both the entire image and the zoomed view responses agree; otherwise, it abstains. To directly address verification hallucination in single-model self-checking, our main idea is to verify gate consistency across different image views rather than re-reading the model's own text. Experimental evaluation on VQA-RAD, SLAKE, and PathVQA using Qwen2.5-VL-7B reports that EVADE is the only method that simultaneously improves both calibration and selective risk while maintaining accuracy, reducing expected calibration error (ECE) by up to 45% compared to zero-shot. Chain-of-thought, self-consistency, and self-verification all fail at least one axis. A grounding analysis reports that self-proposed regions perform better at diagnostic structure localisation than centres or random crops. However, a 7B VLM cannot use this localisation to revise answers. Therefore, reliability gains come from the consistency gate and calibrated abstention.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。