arXiv:2509.13760cs.CV2025-09EMNLP被引 7

用视觉反馈迭代优化提示,让文生图更安全可靠

Iterative Prompt Refinement for Safer Text-to-Image Generation

  • 结合图像与提示的双模态反馈,动态修正生成过程
  • 在不偏离用户意图的前提下,显著降低有害内容生成率
  • 适合关注生成安全性的研究者与应用开发者

文生图模型虽有显著进展,但输出质量和安全性仍高度依赖提示词表述。现有安全方法多依赖大语言模型(LLM)修改提示,却忽略生成图像本身,易导致安全漏洞或对本已安全的提示进行无谓调整。为此,本文提出一种基于视觉语言模型(VLM)的迭代提示优化算法,通过分析输入提示和生成图像,利用视觉反馈实现更精准的提示修正。同时,我们构建了一个包含文本与视觉安全标签的新数据集,基于现成多模态大模型标注,支持监督微调。实验表明,该方法在保持用户意图一致性的同时显著提升安全性,性能与现有基于LLM的方法相当,为安全文生图提供了一种实用方案。代码已开源。

原文摘要 · Abstract (English)

Text-to-Image (T2I) models have made remarkable progress in generating images from text prompts, but their output quality and safety still depend heavily on how prompts are phrased. Existing safety methods typically refine prompts using large language models (LLMs), but they overlook the images produced, which can result in unsafe outputs or unnecessary changes to already safe prompts. To address this, we propose an iterative prompt refinement algorithm that uses Vision Language Models (VLMs) to analyze both the input prompts and the generated images. By leveraging visual feedback, our method refines prompts more effectively, improving safety while maintaining user intent and reliability comparable to existing LLM-based approaches. Additionally, we introduce a new dataset labeled with both textual and visual safety signals using off-the-shelf multi-modal LLM, enabling supervised fine-tuning. Experimental results demonstrate that our approach produces safer outputs without compromising alignment with user intent, offering a practical solution for generating safer T2I content. Our code is available at https://github.com/ku-dmlab/IPR. \textbf{\textcolor{red}WARNING: This paper contains examples of harmful or inappropriate images generated by models.

文生图安全生成提示优化多模态

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。