arXiv:2604.11082cs.CV2026-04被引 2

用参考帧对比提升游戏画面漏洞检测准确率

RESP: Reference-guided Sequential Prompting for Visual Glitch Detection in Video Games

  • 通过前后帧对比,将漏洞检测转为视频内一致性判断
  • 在五个数据集上显著提升帧级与视频级检测效果
  • 适合游戏质量测试、自动化验证场景使用

游戏画面漏洞会降低玩家体验和品质感知,但人工质检难以应对现代游戏日益扩大的测试范围。现有自动化方法多基于单帧或有限的视频级基准,面对真实场景变化时表现不佳。本文提出RESP框架,利用视觉语言模型进行多帧漏洞检测。核心思想是:对每一帧选取视频中更早的参考帧,建立视觉基线,将检测任务转化为视频内对比而非孤立分类。通过顺序提示模型处理参考/待测帧对,并聚合噪声化的帧级预测,实现无需微调的稳定视频级判定。为可控分析参考作用,我们构建了RefGlitch——一个包含五类漏洞的合成数据集,涵盖手动标注的参考/待测帧对。在五个VLM和三个数据集(一个合成、两个真实)上的实验表明,参考引导显著提升帧级检测性能,且改进后的帧级证据能可靠传递至更强的视频级分类能力,在真实质检条件下表现优异。代码与数据已公开。

原文摘要 · Abstract (English)

Visual glitches in video games degrade player experience and perceived quality, yet manual quality assurance cannot scale to the growing test surface of modern game development. Prior automation efforts, particularly those using vision-language models (VLMs), largely operate on single frames or rely on limited video-level baselines that struggle under realistic scene variation, making robust video-level glitch detection challenging. We present RESP, a practical multi-frame framework for gameplay glitch detection with VLMs. Our key idea is reference-guided prompting: for each test frame, we select a reference frame from earlier in the same video, establishing a visual baseline and reframing detection as within-video comparison rather than isolated classification. RESP sequentially prompts the VLM with reference/test pairs and aggregates noisy frame predictions into a stable video-level decision without fine-tuning the VLM. To enable controlled analysis of reference effects, we introduce RefGlitch, a synthetic dataset of manually labeled reference/test frame pairs with balanced coverage across five glitch types. Experiments across five VLMs and three datasets (one synthetic, two real-world) show that reference guidance consistently strengthens frame-level detection and that the improved frame-level evidence reliably transfers to stronger video-level triage under realistic QA conditions. Code and data are available at: \href{https://github.com/PipiZong/RESP_code.git}{this https URL}.

视觉检测游戏质检多帧分析提示工程

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。