模型常靠文字线索作弊通过视觉任务评测,需提前自测漏洞。
Benchmark Designers Should "Train on the Test Set" to Expose Exploitable Non-Visual Shortcuts
- 用测试集文本数据训练语言模型,检测视觉任务中的文字捷径。
- 在四个基准上发现普遍非视觉偏差,最高可使模型准确率提升至92%。
- 提出迭代删减高偏差样本方法,适合评测设计者与模型鲁棒性研究者。
稳健的多模态评测对评估多模态大语言模型(MLLMs)至关重要。然而我们发现,模型可在无需真正视觉理解的情况下,在多个多模态评测中取得高分,仅依赖偏见、语言先验和表面模式。这尤其影响以视觉为核心的评测。我们提出评测设计应遵循“若可被利用,必会被利用”的诊断原则:设计者应先行“作弊”,通过诊断与去偏流程系统识别并缓解非视觉偏差。有效诊断需直接“训练于测试集”——探测公开测试集中固有的可利用模式。我们提出两个组件:一是“测试集压力测试”(TsT),通过k折交叉验证仅用测试集文本输入微调强大语言模型,揭示捷径表现并为每样本赋偏见分数s(x);二是基于随机森林的轻量级诊断工具,用于快速可解释审计。二是通过“迭代偏见剪枝”(IBP)过滤高偏见样本。在VSI-Bench、CV-Bench、MMMU和VideoMME四个基准上应用该框架,均发现广泛存在的非视觉偏差。以VSI-Bench为例,构建的VSI-Bench-Debiased版本显著降低非视觉可解性,且视觉盲区性能差距扩大至原版的1.8倍。
原文摘要 · Abstract (English)
Robust benchmarks are crucial for evaluating Multimodal Large Language Models (MLLMs). Yet we find that models can ace many multimodal benchmarks without strong visual understanding, instead exploiting biases, linguistic priors, and superficial patterns. This is especially problematic for vision-centric benchmarks that are meant to require visual inputs. We adopt a diagnostic principle for benchmark design: if a benchmark can be gamed, it will be. Designers should therefore try to ``game'' their own benchmarks first, using diagnostic and debiasing procedures to systematically identify and mitigate non-visual biases. Effective diagnosis requires directly ``training on the test set'' -- probing the released test set for its intrinsic, exploitable patterns. We operationalize this standard with two components. First, we diagnose benchmark susceptibility using a ``Test-set Stress-Test'' (TsT) methodology. Our primary diagnostic tool involves fine-tuning a powerful Large Language Model via $k$-fold cross-validation on exclusively the non-visual, textual inputs of the test set to reveal shortcut performance and assign each sample a bias score $s(x)$. We complement this with a lightweight Random Forest-based diagnostic operating on hand-crafted features for fast, interpretable auditing. Second, we debias benchmarks by filtering high-bias samples using an ``Iterative Bias Pruning'' (IBP) procedure. Applying this framework to four benchmarks -- VSI-Bench, CV-Bench, MMMU, and VideoMME -- we uncover pervasive non-visual biases. As a case study, we apply our full framework to create VSI-Bench-Debiased, demonstrating reduced non-visual solvability and a wider vision-blind performance gap than the original.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。