测试大模型能否识别视听错位,发现模型易被视觉误导。
When Eyes and Ears Disagree: Can MLLMs Discern Audio-Visual Confusion?
- 用音频缺失视频对象构建新基准,模拟视听混淆场景
- 提出强化学习协作框架,使模型在音频引导下提升判断力
- 适合关注多模态推理鲁棒性的研究者与工程师
多模态大语言模型(MLLMs)能否识别视觉存在但无声音的物体?为此,我们提出了新基准AV-ConfuseBench,通过修改视频中物体的音效(如静音发声物体),模拟视听混淆场景。实验表明,Qwen2.5-Omni和Gemini 2.5等模型因视觉主导而难以区分不存在的音频。为此,我们基于Qwen2.5-Omni构建了基于强化学习的协作多模型框架RL-CoMM:第一阶段引入大音频语言模型(LALM)作为音频独立推理参考,设计分步推理奖励函数,引导模型自优化音频视觉推理;第二阶段采用以答案为中心的置信度优化,减少异构推理差异带来的不确定性。在音频视觉问答与幻觉检测任务上,仅需少量训练数据,RL-CoMM相较基线模型准确率提升10~30%。
原文摘要 · Abstract (English)
Can Multimodal Large Language Models (MLLMs) discern confused objects that are visually present but audio-absent? To study this, we introduce a new benchmark, AV-ConfuseBench, which simulates an ``Audio-Visual Confusion'' scene by modifying the corresponding sound of an object in the video, e.g., mute the sounding object and ask MLLMs Is there a/an muted-object sound''. Experimental results reveal that MLLMs, such as Qwen2.5-Omni and Gemini 2.5, struggle to discriminate non-existent audio due to visually dominated reasoning. Motivated by this observation, we introduce RL-CoMM, a Reinforcement Learning-based Collaborative Multi-MLLM that is built upon the Qwen2.5-Omni foundation. RL-CoMM includes two stages: 1) To alleviate visually dominated ambiguities, we introduce an external model, a Large Audio Language Model (LALM), as the reference model to generate audio-only reasoning. Then, we design a Step-wise Reasoning Reward function that enables MLLMs to self-improve audio-visual reasoning with the audio-only reference. 2) To ensure an accurate answer prediction, we introduce Answer-centered Confidence Optimization to reduce the uncertainty of potential heterogeneous reasoning differences. Extensive experiments on audio-visual question answering and audio-visual hallucination show that RL-CoMM improves the accuracy by 10~30\% over the baseline model with limited training data. Follow: https://github.com/rikeilong/AVConfusion.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。