arXiv:2509.09658cs.CV2025-09被引 3

评测多模态大模型在图像理解中拒绝错误选项的能力,提升AI可信度。

Measuring Epistemic Humility in Multimodal Large Language Models

  • 构建新基准HumbleBench,强制模型在多项选择中识别无效选项并放弃回答。
  • 基于全景场景图数据集,用细粒度标注生成带'以上都不对'选项的问题。
  • 发现多数模型在拒绝错误选项上表现不佳,凸显可信AI评估短板。

多模态大语言模型(MLLMs)的幻觉问题——即生成与输入图像不符的内容——在现实应用中带来重大风险,如视觉问答中的误导信息或决策中的安全隐患。现有基准主要测试识别准确率,即模型能否从干扰项中选出正确答案,却忽视了另一关键能力:当所有选项均未被图像支持时,模型应能识别并避免错误选择,这是一种与谦逊相关的可靠行为。为此,本文提出HumbleBench,一个专为评估MLLMs在强制选择场景下拒绝错误选项能力而设计的新基准,包含“以上都不对”选项。该数据集源自全景场景图数据集,利用细粒度的对象与关系标注,结合候选属性线索,并通过GPT-4-Turbo生成多项选择题,再经严格人工筛选。每个问题均包含“以上都不对”选项,要求模型不仅识别正确视觉信息,还需判断所提供选项是否均不成立。我们评估了多种前沿MLLMs——包括通用型、专用推理型及商用模型——在HumbleBench上的表现,并向社区报告实证结果。通过显式引入虚假选项拒绝机制,HumbleBench填补了当前评估体系的关键空白,聚焦于可信多模态推理中关键的回避性行为。代码与数据集已公开,可访问https://github.com/maifoundations/HumbleBench。

原文摘要 · Abstract (English)

Hallucinations in multimodal large language models (MLLMs) -- where the model generates content inconsistent with the input image -- pose significant risks in real-world applications, from misinformation in visual question answering to unsafe errors in decision-making. Existing benchmarks primarily test recognition accuracy, i.e., evaluating whether models can select the correct answer among distractors. This overlooks another important capability for trustworthy AI: recognizing when none of the provided options is supported by the image and abstaining from committing to a false choice, a humility-related behavior. We present HumbleBench, a new hallucination benchmark designed to evaluate false-option rejection in MLLMs under a forced-choice multiple-choice setting with a ``None of the above'' option. Built from a panoptic scene graph dataset, we leverage fine-grained scene graph annotations for objects and relations, use candidate attribute cues, and prompt GPT-4-Turbo to generate multiple-choice questions, followed by a rigorous manual filtering process. Each question includes a ``None of the above'' option, requiring models not only to recognize correct visual information but also to identify when no provided answer is valid. We evaluate a variety of state-of-the-art MLLMs -- including general-purpose, specialized reasoning, and proprietary models -- on HumbleBench and report empirical findings for the community. By incorporating explicit false-option rejection, HumbleBench fills a key gap in current evaluation suites by assessing a narrower but important abstention-oriented behavior that is relevant to trustworthy multimodal reasoning. Our code and dataset are released publicly and can be accessed at \href{https://github.com/maifoundations/HumbleBench}{https://github.com/maifoundations/HumbleBench}.

多模态幻觉检测可信AI

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。