首次系统检测视频大模型输出重复问题,发现其极易被时间扰动触发。
VideoSTF: Stress-Testing Output Repetition in Video Large Language Models
- 提出三类基于n-gram的重复度量方法,构建标准化测试框架
- 在1万段视频上测试发现,90%以上模型对时间扰动敏感
- 揭示输出重复是可被利用的安全漏洞,适合评估视频模型稳定性
视频大语言模型(VideoLLMs)在视频理解任务中表现强劲,但我们发现一种此前未被重视的生成失败:严重输出重复,即模型陷入自我强化的重复短语或句子循环。现有评测基准主要关注任务准确性和事实正确性,未涵盖此问题。本文提出VideoSTF,首个系统测量和压力测试视频大模型输出重复的框架。该框架采用三种互补的n-gram基度量方法,并提供包含10,000段多样化视频的标准测试集及一系列可控的时间变换工具。我们对10个先进VideoLLMs进行了广泛测试、时间压力测试和对抗性攻击实验。结果表明,输出重复普遍存在,且对输入视频的时间扰动高度敏感。更重要的是,简单的时序变换即可在黑盒环境下高效诱发重复退化,暴露输出重复作为可被利用的安全漏洞。研究揭示输出重复是现代VideoLLMs的根本稳定性问题,呼吁开展稳定性感知的评估。代码与脚本已开源:https://github.com/yuxincao22/VideoSTF_benchmark。
原文摘要 · Abstract (English)
Video Large Language Models (VideoLLMs) have recently achieved strong performance in video understanding tasks. However, we identify a previously underexplored generation failure: severe output repetition, where models degenerate into self-reinforcing loops of repeated phrases or sentences. This failure mode is not captured by existing VideoLLM benchmarks, which focus primarily on task accuracy and factual correctness. We introduce VideoSTF, the first framework for systematically measuring and stress-testing output repetition in VideoLLMs. VideoSTF formalizes repetition using three complementary n-gram-based metrics and provides a standardized testbed of 10,000 diverse videos together with a library of controlled temporal transformations. Using VideoSTF, we conduct pervasive testing, temporal stress testing, and adversarial exploitation across 10 advanced VideoLLMs. We find that output repetition is widespread and, critically, highly sensitive to temporal perturbations of video inputs. Moreover, we show that simple temporal transformations can efficiently induce repetitive degeneration in a black-box setting, exposing output repetition as an exploitable security vulnerability. Our results reveal output repetition as a fundamental stability issue in modern VideoLLMs and motivate stability-aware evaluation for video-language systems. Our evaluation code and scripts are available at: https://github.com/yuxincao22/VideoSTF_benchmark.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。