用文本生成图像反向纠错,让视觉语言模型少说假话。
Self-Correcting Decoding with Generative Feedback for Mitigating Hallucinations in Large Vision-Language Models
- 用文本生成图像作反馈,让模型自我检查回答是否合理
- 在六个基准上都优于现有方法,有效减少幻觉现象
- 无需重新训练,可直接部署于现有视觉语言模型
尽管大型视觉语言模型(LVLM)在多模态任务中表现优异,但其常产生与输入图像不符的幻觉性文本,限制了实际应用。受文本生成图像过程与图像条件响应生成互为逆过程的启发,本文探索利用文本到图像生成模型为LVLM提供自反馈以缓解幻觉。研究发现,生成模型可在响应和词元层面提供有效反馈。基于此,提出无需训练的自纠正解码算法DeGF:从LVLM初始输出生成图像作为辅助视觉参考,通过互补或对比解码验证并修正原回答。大量实验表明,该方法在六个基准上持续超越现有最优方法,有效缓解多种幻觉类型。代码已开源:https://github.com/zhangce01/DeGF。
原文摘要 · Abstract (English)
While recent Large Vision-Language Models (LVLMs) have shown remarkable performance in multi-modal tasks, they are prone to generating hallucinatory text responses that do not align with the given visual input, which restricts their practical applicability in real-world scenarios. In this work, inspired by the observation that the text-to-image generation process is the inverse of image-conditioned response generation in LVLMs, we explore the potential of leveraging text-to-image generative models to assist in mitigating hallucinations in LVLMs. We discover that generative models can offer valuable self-feedback for mitigating hallucinations at both the response and token levels. Building on this insight, we introduce self-correcting Decoding with Generative Feedback (DeGF), a novel training-free algorithm that incorporates feedback from text-to-image generative models into the decoding process to effectively mitigate hallucinations in LVLMs. Specifically, DeGF generates an image from the initial response produced by LVLMs, which acts as an auxiliary visual reference and provides self-feedback to verify and correct the initial response through complementary or contrastive decoding. Extensive experimental results validate the effectiveness of our approach in mitigating diverse types of hallucinations, consistently surpassing state-of-the-art methods across six benchmarks. Code is available at https://github.com/zhangce01/DeGF.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。