提出细粒度幻觉诊断框架,可精准定位并解释多模态模型的幻觉类型。
HalluScope: Fine-grained Hallucination Diagnosis for Multimodal Large Language Models

- 构建统一任务,同时完成幻觉检测、分类与可解释性说明生成。
- 基于3万条数据训练的模型在多个基准上达到领先性能。
- 诊断结果能有效指导模型修正幻觉,适合研究与优化多模态系统者使用。
尽管多模态大语言模型在众多视觉-语言任务中表现强劲,但仍存在与视觉内容、文本上下文或常识不符的幻觉问题。现有研究多采用粗粒度检测,难以提供足够的诊断信息。为此,本文提出多模态大模型的细粒度幻觉诊断新任务,实现幻觉检测、分类与可解释性说明生成的联合优化。我们构建了包含8类来源、5个任务类别的大规模诊断数据集HalluScope-30K,并设计多粒度联合奖励函数,训练出HalluScope-4B与HalluScope-8B两个诊断模型,在MHALO与自建分类基准上均达最优。检测与分类在联合优化下相互促进。诊断驱动的反馈实验表明,本模型生成的细粒度解释能有效引导目标模型修正幻觉,对Qwen3-VL-8B-Instruct与LLaVA-1.5-7B的改进显著优于所有基线。代码、数据与模型已开源。
原文摘要 · Abstract (English)
Although Multimodal Large Language Models have achieved strong performance across a wide range of vision-language tasks, they still suffer from hallucinations, where model outputs become inconsistent with the visual content, textual context, or commonsense knowledge. Existing studies primarily address this problem through coarse-grained detection. However, these approaches often provide insufficient diagnostic information for understanding hallucination types and supporting downstream hallucination mitigation. To bridge this gap, we propose fine-grained hallucination diagnosis for MLLMs, a new unified task that jointly performs hallucination detection, classification, and interpretable explanation generation. We develop an automated data generation pipeline and construct HalluScope-30K, a large-scale diagnostic dataset covering eight sources and five task categories. Based on this dataset, we design a multi-granular joint reward function and train two diagnosis models, HalluScope-4B and HalluScope-8B, which achieve state-of-the-art performance on both the MHALO benchmark and our fine-grained hallucination classification benchmark. Notably, detection and classification are mutually beneficial under joint optimization. Furthermore, diagnosis-driven feedback experiments show that the fine-grained diagnostic explanations produced by our model effectively guide target models to correct their hallucinations, with full diagnosis substantially outperforming all baselines on both Qwen3-VL-8B-Instruct and LLaVA-1.5-7B. Our code, data, and models are available at https://github.com/wkinglin/HalluScope.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。