arXiv:2605.18313cs.CVcs.AI2026-05

用数学博弈方法让小模型答对医学问题,又快又准。

Wasserstein Equilibrium Decoding for Reliable Medical Visual Question Answering

论文配图:Wasserstein Equilibrium Decoding for Reliable Medical Visual Question Answering
图 1 · 摘自论文原文
  • 引入基于语义的瓦斯赫斯坦停止准则,替代传统字面匹配。
  • 在两个医学数据集上比贪心和判别式方法提升3.5个百分点。
  • 适合资源受限但要求高可靠性的临床医疗问答场景。

小型视觉语言模型(2-8B)因隐私保护、连接受限及低延迟需求,适用于临床部署。然而其容量有限,易生成看似合理实则错误的答案。本文将博弈论解码从纯文本封闭任务拓展至开放式的医学视觉问答(Medical VQA),提出语义感知的瓦斯赫斯坦停止准则,取代传统的词汇顺序匹配,使收敛基于近义答案间的语义共识,避免因临床等效答案排名互换引发的冗余迭代。在VQA-RAD与PathVQA数据集上,相较贪婪和判别式基线均取得显著提升。在VQA-RAD上,Qwen3-VL-2B性能提升3.5个百分点(p < 0.01),超越贪心策略下的4B模型;在更大规模模型上亦呈现一致趋势。在PathVQA上,未经过领域微调的Gemma-3-4B+BDG表现媲美未经微调的MedGemma-4B。在与经典BDG准确率相当的前提下,瓦斯赫斯坦准则将平均收敛迭代次数减少约20%,显著提升推理效率,同时保持博弈均衡行为。代码已开源:https://github.com/luca-hagen/Wasserstein-BDG-medical-VQA。

原文摘要 · Abstract (English)

Small vision-language models (2-8B) are well-suited for clinical deployment due to privacy constraints, limited connectivity, and low-latency requirements favouring on-device or on-premise inference. However, their limited capacity exacerbates the generation of plausible but incorrect outputs. We extend game-theoretic decoding, previously restricted to text-only, closed-ended NLP tasks, to vision-language models for open-ended Medical VQA. We introduce a semantically aware Wasserstein stopping criterion that replaces lexical order matching, enabling convergence based on semantic consensus among near-synonymous candidate answers and avoiding unnecessary iterations caused by clinically equivalent ranking swaps. On VQA-RAD and PathVQA, we obtain consistent, statistically significant improvements over greedy and discriminative baselines. On VQA-RAD, we improve Qwen3-VL-2B by +3.5 percentage points (p < 0.01), surpassing the greedy 4B model, with similar trends at larger scales. On PathVQA, Gemma-3-4B with BDG matches MedGemma-4B under greedy decoding despite no domain-specific fine-tuning. At accuracy parity with classic BDG, the Wasserstein criterion reduces average convergence iterations by approximately 20%, improving inference efficiency while preserving the game-theoretic equilibrium behaviour. Code is available at https://github.com/luca-hagen/ Wasserstein-BDG-medical-VQA.

医学问答视觉语言模型博弈解码小模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。