arXiv:2606.23679cs.CVcs.AI2026-06

让AI生成有逻辑的图像变体,用户可系统探索设计选择。

Semantic Browsing: Controllable Diversity for Image Generation

论文配图:Semantic Browsing: Controllable Diversity for Image Generation
图 1 · 摘自论文原文
  • 在文本层面引入结构化变化,而非依赖随机采样
  • 生成的每张图都对应一个明确可理解的设计决策
  • 适合需要可控创意探索的设计师和研究者

当前文生图模型在视觉质量与提示遵循上表现优异,但过度依赖提示导致生成结果缺乏多样性,往往坍缩为单一视觉解释。现有提升多样性的方法多依赖偶然性变化,而非有意义的设计选择。为此,本文提出一种受控多样性方法,支持语义浏览——用户可系统遍历结构化图像画廊,实现有方向的创意探索。该方法利用近期文生图模型训练时使用的详尽描述,将语义决策与像素生成解耦。通过让视觉语言模型(VLM)基于完整场景上下文进行推理,并采用代理式工作流强制结构化变化,克服了标准VLM生成内容泛化的缺陷。实验表明,该方法生成的图像空间具有高度可导航性,每个变体均对应具体、可理解的语义调整。

原文摘要 · Abstract (English)

Modern text-to-image models excel in visual fidelity and prompt adherence. However, this strict adherence comes at the cost of diversity: generated samples tend to collapse into a single visual interpretation. Existing methods to improve diversity produce outputs driven by incidental variations rather than meaningful design choices. This motivates a new variant of the diversity task where structure is enforced on the generated samples. We introduce a method for controlled diversity that enables Semantic Browsing, where users can navigate structured image galleries and experience creative exploration through a systematic traversal of meaningful, interpretable axes of variation. Achieving this level of semantic control requires a deep understanding of the scene. We exploit the fact that recent text-to-image models are trained on elaborated captions, effectively decoupling semantic decision-making from pixel generation. This enables a paradigm shift: instead of relying on stochastic variation within the text-to-image model, we induce diversity directly at the text level. By leveraging rich textual representations, we allow a Vision Language Model (VLM) to operate on the full scene context. To overcome the generic outputs typical of standard VLMs, we employ an agentic workflow that explicitly enforces structured variation attuned to the original prompt. We demonstrate that our method produces diverse and navigable design spaces where every variation corresponds to a specific, user-understandable semantic decision.

图像生成语义控制创意探索

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。