arXiv:2604.09529cs.CVcs.AI2026-04ACL被引 5

为视觉语言模型分离视觉与推理置信度,减少幻觉错误。

VL-Calibration: Decoupled Confidence Calibration for Large Vision-Language Models Reasoning

  • 用强化学习将置信度拆分为视觉和推理两部分
  • 在13个基准上提升校准精度与视觉推理准确率
  • 适合高风险场景下需要可信输出的视觉语言模型

大型视觉语言模型(LVLM)虽具备强大多模态推理能力,但常在高确定性下产生幻觉和错误回答,限制其在高风险领域的应用。现有基于文本的置信度校准方法通常仅优化单一整体置信分数,以答案正确与否作为监督信号,不适用于LVLM:错误可能源于感知失败或推理失误,而单一置信度混淆了这两种来源,且视觉不确定性常被语言先验主导。为此,我们提出VL-Calibration,一种显式解耦视觉与推理置信度的强化学习框架。为在无真实感知标签的情况下监督视觉置信度,引入内在视觉确定性估计,结合(i)图像扰动下的KL散度测量视觉定位强度,以及(ii)token熵测量内部确定性。进一步提出基于视觉确定性的词元级优势重加权机制,聚焦于高视觉确定性区域,抑制无根据幻觉的同时保留有效感知。在13个基准上的实验表明,该方法显著提升校准性能并增强视觉推理准确率,且在跨模型规模与架构的分布外任务中具有良好泛化能力。

原文摘要 · Abstract (English)

Large Vision Language Models (LVLMs) achieve strong multimodal reasoning but frequently exhibit hallucinations and incorrect responses with high certainty, which hinders their usage in high-stakes domains. Existing verbalized confidence calibration methods, largely developed for text-only LLMs, typically optimize a single holistic confidence score using binary answer-level correctness. This design is mismatched to LVLMs: an incorrect prediction may arise from perceptual failures or from reasoning errors given correct perception, and a single confidence conflates these sources while visual uncertainty is often dominated by language priors. To address these issues, we propose VL-Calibration, a reinforcement learning framework that explicitly decouples confidence into visual and reasoning confidence. To supervise visual confidence without ground-truth perception labels, we introduce an intrinsic visual certainty estimation that combines (i) visual grounding measured by KL-divergence under image perturbations and (ii) internal certainty measured by token entropy. We further propose token-level advantage reweighting to focus optimization on tokens based on visual certainty, suppressing ungrounded hallucinations while preserving valid perception. Experiments on thirteen benchmarks show that VL-Calibration effectively improves calibration while boosting visual reasoning accuracy, and it generalizes to out-of-distribution benchmarks across model scales and architectures.

视觉语言模型置信度校准幻觉抑制强化学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。