提出自知机制,减少低层视觉任务中的幻觉问题。
Mitigating Low-Level Visual Hallucinations Requires Self-Awareness: Database, Model and Training Strategy
- 构建首个低层视觉幻觉指令数据库,含20万条问答对。
- 设计SAFEQA模型,融合图像特征与质量特征提升感知能力。
- 提出ESA-PO优化框架,增强模型对知识边界的自我认知。
多模态大语言模型在视觉理解方面取得显著进展,将多种任务整合至统一的视觉问答框架中。然而,这些模型易产生幻觉,影响其作为人工智能系统的可靠性。尽管自然语言处理和图像描述领域对此问题研究广泛,但针对低层视觉感知与理解(HLPU)任务中的幻觉研究仍属空白,尤其在图像质量评估任务中。本文认为幻觉源于模型缺乏清晰的自我意识。为此,我们首次构建了专注于低层视觉任务幻觉的HLPU指令数据库,包含约20万条问答对,分为四个子集,覆盖不同类型的指令。随后提出Self-Awareness Failure Elimination (SAFEQA)模型,利用图像特征、显著区域特征和质量特征,提升模型在低层视觉任务中的感知与理解能力。进一步提出Enhancing Self-Awareness Preference Optimization (ESA-PO)框架,强化模型对知识边界的认知,从而降低幻觉发生率。在低层视觉任务上的全面实验表明,所提方法显著提升了模型的自我意识,有效减少幻觉。值得注意的是,该方法同时提升了模型的准确率与自我意识,在多项评估指标上优于闭源模型。
原文摘要 · Abstract (English)
The rapid development of multimodal large language models has resulted in remarkable advancements in visual perception and understanding, consolidating several tasks into a single visual question-answering framework. However, these models are prone to hallucinations, which limit their reliability as artificial intelligence systems. While this issue is extensively researched in natural language processing and image captioning, there remains a lack of investigation of hallucinations in Low-level Visual Perception and Understanding (HLPU), especially in the context of image quality assessment tasks. We consider that these hallucinations arise from an absence of clear self-awareness within the models. To address this issue, we first introduce the HLPU instruction database, the first instruction database specifically focused on hallucinations in low-level vision tasks. This database contains approximately 200K question-answer pairs and comprises four subsets, each covering different types of instructions. Subsequently, we propose the Self-Awareness Failure Elimination (SAFEQA) model, which utilizes image features, salient region features and quality features to improve the perception and comprehension abilities of the model in low-level vision tasks. Furthermore, we propose the Enhancing Self-Awareness Preference Optimization (ESA-PO) framework to increase the model's awareness of knowledge boundaries, thereby mitigating the incidence of hallucination. Finally, we conduct comprehensive experiments on low-level vision tasks, with the results demonstrating that our proposed method significantly enhances self-awareness of the model in these tasks and reduces hallucinations. Notably, our proposed method improves both accuracy and self-awareness of the proposed model and outperforms close-source models in terms of various evaluation metrics.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。