arXiv:2409.16597cs.CV2024-09被引 67

提出视频大模型事件幻觉评估基准,揭示开源模型严重幻觉问题。

EventHallusion: Diagnosing Event Hallucinations in Video LLMs

  • 构建事件幻觉评估基准,检测视频大模型对语言先验和视觉-语言偏见的敏感性。
  • 8个开源模型在基准上表现差,闭源模型显著更优,暴露幻觉缺陷。
  • 提出时序对比解码方法,通过破坏时间线索修正模型幻觉,提升性能。

多模态大语言模型(MLLMs)在视频理解领域取得显著进展,尽管其内容推理和指令遵循能力突出,但相较于图像领域,视频大模型的幻觉问题仍研究不足。为此,我们提出EventHallusion——一个专注于评估视频大模型事件幻觉的新基准。从幻觉溯源角度,该基准旨在衡量模型对语言先验和视觉-语言偏见的敏感性。同时,我们提出一种简单有效的时序对比解码(Temporal Contrastive Decoding, TCD)方法,通过在解码阶段对比原始视频与时间线索被破坏的修改版本,纠正模型对先验的依赖。在所提EventHallusion基准上对8个开源和2个闭源视频大模型进行综合评估,发现开源模型存在严重幻觉,而闭源模型表现显著更优。进一步将TCD方法应用于开源模型,在大部分指标上均实现明显性能提升。代码与数据集已公开于https://github.com/Stevetich/EventHallusion。

原文摘要 · Abstract (English)

Recently, Multimodal Large Language Models (MLLMs) have made significant progress in the video comprehension field. Despite remarkable content reasoning and instruction following capabilities they demonstrated, the hallucination problem of these VideoLLMs is less explored compared with its counterpart in the image domain. To mitigate this gap, we propose EventHallusion, a novel benchmark that focuses on assessing the VideoLLMs' hallucination toward event, the crux of video analysis. From a hallucination attribution perspective, our EventHallusion benchmark is curated to assess a VideoLLM's susceptibility toward language priors and vision-language biases. On the other hand, we also propose a simple yet effective method, called Temporal Contrastive Decoding (TCD), to tackle the hallucination problems of VideoLLMs. The proposed TCD method rectifies the model's bias toward its priors during the decoding stage by comparing the original video with a modified version, in which temporal cues are disrupted. Through comprehensive evaluation of eight open-source and two closed-source VideoLLMs on the proposed EventHallusion benchmark, we observe that the open-source models suffer significantly from hallucination problems, whereas the closed-source ones perform markedly better. By further equipping open-source VideoLLMs with the proposed TCD approach, evident performance improvements are achieved across most metrics in the EventHallusion benchmark. Our codes and benchmark data are available at https://github.com/Stevetich/EventHallusion.

视频理解幻觉检测大模型评估时序建模

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。