发现音视频大模型中跨模态信息的集中存储位置,并据此提出无需训练的幻觉抑制方法。
Probing Cross-modal Information Hubs in Audio-Visual LLMs

- 通过分析音视频大模型,定位跨模态信息在特定令牌中的存储机制。
- 揭示了部分专用令牌专门负责存储音视频融合信息。
- 提出利用这些专用令牌提升模型可信度,适合关注多模态可靠性研究者。
音视频大语言模型(AVLLMs)作为一种能够联合推理音频、视觉和文本模态的强大架构逐渐兴起。在这些模型中,音频与视频模态之间的双向交互引入了复杂的处理动态,亟需深入理解其内部机制。然而,与广泛研究的纯文本或大视觉语言模型不同,AVLLMs的内部运作仍鲜有探索。本文聚焦于AVLLMs中音频与视觉模态间的跨模态信息流,探究某一模态的信息如何被编码到另一模态的令牌表示中。通过对多个近期AVLLMs的分析,我们发现两个普遍规律:第一,AVLLMs主要将融合的音视频信息编码在‘汇聚令牌’(sink tokens)中;第二,汇聚令牌并非均匀承载跨模态信息,而是存在一类特化的‘跨模态汇聚令牌’,专门用于存储此类信息。基于此发现,我们进一步提出一种无需训练的幻觉缓解方法,通过鼓励模型依赖跨模态汇聚令牌中的整合信息来提升输出可信度。代码已公开于https://github.com/kaistmm/crossmodal-hub。
原文摘要 · Abstract (English)
Audio-visual large language models (AVLLMs) have recently emerged as a powerful architecture capable of jointly reasoning over audio, visual, and textual modalities. In AVLLMs, the bidirectional interaction between audio and video modalities introduces intricate processing dynamics, necessitating a deeper understanding of their internal mechanisms. However, unlike extensively studied text-only or large vision language models, the internal workings of AVLLMs remain largely unexplored. In this paper, we focus on cross-modal information flow between audio and visual modalities in AVLLMs, investigating where information derived from one modality is encoded within the token representations of the other modality. Through an analysis of multiple recent AVLLMs, we uncover two common findings. First, AVLLMs primarily encode integrated audio-visual information in sink tokens. Second, sink tokens do not uniformly hold cross-modal information. Instead, a distinct subset of sink tokens, which we term cross-modal sink tokens, specializes in storing such information. Based on these findings, we further propose a simple training-free hallucination mitigation method by encouraging reliance on integrated cross-modal information within cross-modal sink tokens. Our code is available at https://github.com/kaistmm/crossmodal-hub.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。