arXiv:2604.13073cs.CLcs.AI2026-04被引 1

让多模态大模型生成时自动标注每句话的来源,提升解释性。

OmniTrace: A Unified Framework for Generation-Time Attribution in Omni-Modal LLMs

论文配图:OmniTrace: A Unified Framework for Generation-Time Attribution in Omni-Modal LLMs
图 1 · 摘自论文原文
  • 将生成过程建模为因果解码追踪,实时定位每条输出的输入来源。
  • 在多个任务上比传统方法更稳定、可解释,且不依赖额外训练。
  • 适用于图像、音频、视频等多模态场景,适合关注模型透明性的研究者。

现代多模态大语言模型(MLLM)能从文本、图像、音频和视频等混合输入中生成流畅回应,但难以确定每个生成语句的依据来源。现有归因方法主要针对分类任务、固定预测目标或单模态架构,无法自然扩展到自回归、仅解码器的开放式多模态生成模型。我们提出 OmniTrace,一个轻量级、模型无关的框架,将归因形式化为生成时的因果解码追踪问题。OmniTrace 提供统一协议,将注意力权重或梯度得分等任意粒度信号转化为生成过程中的跨模态、连贯的片段级解释。它追踪每个生成词元对应的多模态输入,聚合信号为语义连贯的片段,并通过置信度加权与时间一致性筛选简洁的支持源,无需重新训练或监督。在 Qwen2.5-Omni 与 MiniCPM-o-4.5 上的视觉、音频与视频任务评估表明,生成感知的片段级归因比朴素自归因与嵌入基基线更稳定、可解释,且对多种归因信号均保持鲁棒。结果表明,将归因视为结构化的生成时追踪问题,可为全模态语言模型提供可扩展的透明性基础。

原文摘要 · Abstract (English)

Modern multimodal large language models (MLLMs) generate fluent responses from interleaved text, image, audio, and video inputs. However, identifying which input sources support each generated statement remains an open challenge. Existing attribution methods are primarily designed for classification settings, fixed prediction targets, or single-modality architectures, and do not naturally extend to autoregressive, decoder-only models performing open-ended multimodal generation. We introduce OmniTrace, a lightweight and model-agnostic framework that formalizes attribution as a generation-time tracing problem over the causal decoding process. OmniTrace provides a unified protocol that converts arbitrary token-level signals such as attention weights or gradient-based scores into coherent span-level, cross-modal explanations during decoding. It traces each generated token to multimodal inputs, aggregates signals into semantically meaningful spans, and selects concise supporting sources through confidence-weighted and temporally coherent aggregation, without retraining or supervision. Evaluations on Qwen2.5-Omni and MiniCPM-o-4.5 across visual, audio, and video tasks demonstrate that generation-aware span-level attribution produces more stable and interpretable explanations than naive self-attribution and embedding-based baselines, while remaining robust across multiple underlying attribution signals. Our results suggest that treating attribution as a structured generation-time tracing problem provides a scalable foundation for transparency in omni-modal language models.

多模态模型解释生成归因

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。