用临床相关性加权优化医疗多模态模型,减少图像误导下的幻觉问题。
MMedPO: Aligning Medical Vision-Language Models with Clinical-Aware Multimodal Preference Optimization

- 通过注入假幻觉和病变区域遮蔽生成对抗样本
- 在医考问答与报告生成任务上提升14.2%~51.7%准确率
- 适合医疗AI研发者及需要高可信度多模态模型的场景
大型视觉语言模型(LVLM)在医疗领域的应用不断推进,但医疗版LVLM(Med-LVLM)因模态错配存在事实性问题,常忽视医学图像信息而依赖文本知识,导致与图像矛盾的幻觉。此前基于偏好优化的方法未能充分考虑偏好数据的临床相关性,使样本易区分,削弱对齐效果。为此,本文提出MMedPO,一种新型多模态医疗偏好优化方法,通过引入两类反偏好样本:(1) 由目标Med-LVLM或GPT-4o注入的合理幻觉,生成医学错误响应;(2) 通过局部病变噪声破坏关键区域视觉理解。再依据多个Med-LLM与视觉工具评分计算每条样本的临床相关性,并作为权重融入偏好优化过程,实现有效对齐。实验表明,MMedPO显著提升Med-LVLM的事实准确性,在Med-VQA与报告生成任务上平均分别提升14.2%和51.7%。代码已开源。
原文摘要 · Abstract (English)
The advancement of Large Vision-Language Models (LVLMs) has propelled their application in the medical field. However, Medical LVLMs (Med-LVLMs) encounter factuality challenges due to modality misalignment, where the models prioritize textual knowledge over visual input, leading to hallucinations that contradict information in medical images. Previous attempts to enhance modality alignment in Med-LVLMs through preference optimization have inadequately mitigated clinical relevance in preference data, making these samples easily distinguishable and reducing alignment effectiveness. To address this challenge, we propose MMedPO, a novel multimodal medical preference optimization approach that considers the clinical relevance of preference samples to enhance Med-LVLM alignment. MMedPO curates multimodal preference data by introducing two types of dispreference: (1) plausible hallucinations injected through target Med-LVLMs or GPT-4o to produce medically inaccurate responses, and (2) lesion region neglect achieved through local lesion-noising, disrupting visual understanding of critical areas. We then calculate clinical relevance for each sample based on scores from multiple Med-LLMs and visual tools, and integrate these scores into the preference optimization process as weights, enabling effective alignment. Our experiments demonstrate that MMedPO significantly enhances factual accuracy in Med-LVLMs, achieving substantial improvements over existing preference optimization methods by averaging 14.2% and 51.7% across the Med-VQA and report generation tasks. Our code are available in https://github.com/aiming-lab/MMedPO.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。