大模型生成图像时无法理解否定指令,导致错误输出。
Negation Blindness in Large Language Models: Unveiling the NO Syndrome in Image Generation
- 模型难以理解含否定词的文本指令,生成与意图相反的图像。
- 测试覆盖GPT-4、Gemini等多模型,均存在此问题。
- 建议引入文本与图像间的强化学习反馈机制来改进。
基础大型语言模型(LLMs)已广泛应用于诗歌创作、编程、论文撰写和解谜等任务,并通过集成图像生成能力变得更加综合与多功能。然而,研究者们仍在探索其局限性以进一步优化。现有已知缺陷包括幻觉、偏见以及绕过限制生成有害内容。本文揭示了LLMs图像生成能力中的一个根本性缺陷,称为“NO综合征”——即模型无法正确理解涉及否定的自然语言提示,从而生成不符合要求的图像。令人惊讶的是,所有测试的LLMs(包括GPT-4、Gemini和Copilot)均表现出该症状。为验证其普遍性,研究在多种语言(英语、印地语、法语)中进行模拟实验,并采用基于熵和基准统计分析的方法。结果表明,该现象普遍存在。此外,研究发现文本与图像响应之间存在持续不一致。为此,提出引入一种基于上下文感知的强化学习反馈环,使文本回应与图像输出协同反映对否定查询的正确理解。
原文摘要 · Abstract (English)
Foundational Large Language Models (LLMs) have changed the way we perceive technology. They have been shown to excel in tasks ranging from poem writing and coding to essay generation and puzzle solving. With the incorporation of image generation capability, they have become more comprehensive and versatile AI tools. At the same time, researchers are striving to identify the limitations of these tools to improve them further. Currently identified flaws include hallucination, biases, and bypassing restricted commands to generate harmful content. In the present work, we have identified a fundamental limitation related to the image generation ability of LLMs, and termed it The NO Syndrome. This negation blindness refers to LLMs inability to correctly comprehend NO related natural language prompts to generate the desired images. Interestingly, all tested LLMs including GPT-4, Gemini, and Copilot were found to be suffering from this syndrome. To demonstrate the generalization of this limitation, we carried out simulation experiments and conducted entropy-based and benchmark statistical analysis tests on various LLMs in multiple languages, including English, Hindi, and French. We conclude that the NO syndrome is a significant flaw in current LLMs that needs to be addressed. A related finding of this study showed a consistent discrepancy between image and textual responses as a result of this NO syndrome. We posit that the introduction of a negation context-aware reinforcement learning based feedback loop between the LLMs textual response and generated image could help ensure the generated text is based on both the LLMs correct contextual understanding of the negation query and the generated visual output.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。