通过自演化蒸馏消除视觉语言模型幻觉,提升可信度。
Identify, Isolate, and Purge: Mitigating Hallucinations in LVLMs via Self-Evolving Distillation
- 从模型内部识别并清除幻觉知识,再蒸馏纯净知识回模型。
- 在POPE-Random上将LLaVA-1.5的F1分数从81.3提升至88.3。
- 适合关注模型可靠性与生成准确性的研究者使用。
大型视觉语言模型(LVLMs)在多媒体等多个领域表现出色,但幻觉问题严重制约其可信度和应用潜力。现有方法多依赖外部工具或多轮推理对比,显著增加推理时间。本文提出自演化蒸馏(SEED),可识别模型内部长期存在的幻觉知识,将其隔离并清除,再将净化后的知识蒸馏回模型,实现自我进化。此外,我们发现传统蒸馏易在输出空间中产生空洞区域,因此提出一种寻找模式的演化方法,通过捕捉纯净知识分布的主模式来避免混乱结果。同时引入幻觉消除适配器,通过学习净化知识纠正原模型的隐含知识。在多个基准测试上验证了SEED的优越性,显著改善了代表性模型(如LLaVA-1.5和InternVL2)的幻觉问题。值得注意的是,LLaVA-1.5在幻觉评估指标POPE-Random上的F1分数从81.3提升至88.3。
原文摘要 · Abstract (English)
Large Vision-Language Models (LVLMs) have demonstrated remarkable advancements in numerous areas such as multimedia. However, hallucination issues significantly limit their credibility and application potential. Existing mitigation methods typically rely on external tools or the comparison of multi-round inference, which significantly increase inference time. In this paper, we propose \textbf{SE}lf-\textbf{E}volving \textbf{D}istillation (\textbf{SEED}), which identifies hallucinations within the inner knowledge of LVLMs, isolates and purges them, and then distills the purified knowledge back into the model, enabling self-evolution. Furthermore, we identified that traditional distillation methods are prone to inducing void spaces in the output space of LVLMs. To address this issue, we propose a Mode-Seeking Evolving approach, which performs distillation to capture the dominant modes of the purified knowledge distribution, thereby avoiding the chaotic results that could emerge from void spaces. Moreover, we introduce a Hallucination Elimination Adapter, which corrects the dark knowledge of the original model by learning purified knowledge. Extensive experiments on multiple benchmarks validate the superiority of our SEED, demonstrating substantial improvements in mitigating hallucinations for representative LVLM models such as LLaVA-1.5 and InternVL2. Remarkably, the F1 score of LLaVA-1.5 on the hallucination evaluation metric POPE-Random improved from 81.3 to 88.3.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。