让多个AI医生按流程逐轮核对影像证据,避免胡说八道。
UCAgents: Unidirectional Convergence for Visual Evidence Anchored Multi-Agent Medical Decision-Making
- 设计多智能体分层协作框架,只许向前验证证据,禁止来回辩论。
- 在4个医学数据集上准确率最高达71.3%,比现有方法高6.0%,耗能降87.7%。
- 适合需要可解释、低延迟医疗决策的临床场景,如影像辅助诊断。
视觉语言模型在医学诊断中展现潜力,但常出现语言流畅却脱离图像证据的现象,削弱临床信任。现有多智能体框架模拟多学科会诊,但开放式讨论加剧文本噪声与计算开销,且未能锚定推理于视觉证据——医学决策的核心。本文提出UCAgents,一种分层多智能体框架,通过结构化证据审计实现单向收敛。借鉴临床流程,该框架禁止角色切换,仅允许定向证据验证,抑制修辞漂移并强化视觉信号提取。引入单轮问询讨论,识别视觉-文本错配风险,联合约束视觉模糊与文本噪声,形成双重噪声瓶颈,并以信息论形式化。在四个医学VQA基准测试中,UCAgents实现最优准确率(PathVQA达71.3%,较顶尖方法提升6.0%),同时降低87.7%的令牌消耗。实验进一步验证其在挖掘更多视觉证据与避免文本干扰之间取得平衡。结果表明,UCAgents兼具诊断可靠性与计算高效性,适用于真实临床部署。代码已开源。
原文摘要 · Abstract (English)
Vision-Language Models (VLMs) show promise in medical diagnosis, yet suffer from reasoning detachment, where linguistically fluent explanations drift from verifiable image evidence, undermining clinical trust. Recent multi-agent frameworks simulate Multidisciplinary Team (MDT) debates to mitigate single-model bias, but open-ended discussions amplify textual noise and computational cost while failing to anchor reasoning to visual evidence, the cornerstone of medical decision-making. We propose UCAgents, a hierarchical multi-agent framework enforcing unidirectional convergence through structured evidence auditing. Inspired by clinical workflows, UCAgents forbids position changes and limits agent interactions to targeted evidence verification, suppressing rhetorical drift while amplifying visual signal extraction. In UCAgents, a one-round inquiry discussion is introduced to uncover potential risks of visual-textual misalignment. This design jointly constrains visual ambiguity and textual noise, a dual-noise bottleneck that we formalize via information theory. Extensive experiments on four medical VQA benchmarks show UCAgents achieves superior accuracy (71.3% on PathVQA, +6.0% over state-of-the-art) with 87.7% lower token cost, the evaluation results further confirm that UCAgents strikes a balance between uncovering more visual evidence and avoiding confusing textual interference. These results demonstrate that UCAgents exhibits both diagnostic reliability and computational efficiency critical for real-world clinical deployment. Code is available at https://github.com/fqhank/UCAgents.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。