让用户逐步参与图像生成,提升创作控制力与创意自由度
Creo: From One-Shot Image Generation to Progressive, Co-Creative Ideation

- 分阶段生成:从草图到高清图,每步可手动或AI编辑
- 锁定机制保留已决选择,减少编辑时的意外变化
- 适合需要全程掌控创意过程的设计师和创作者
文本到图像(T2I)系统虽能快速生成高保真图像,但与视觉构思过程不匹配。现有系统隐式代用户做视觉决策,过早引入细节会限制用户选项,并在编辑时引发难以修正的意外变化,削弱用户控制感。为此,我们提出Creo,一种多阶段T2I系统,通过从草图逐步推进至高分辨率输出,暴露中间抽象层,使用户可在生成过程中持续干预。草图类抽象具有临时性,利于早期设计探索与编辑,且每阶段支持手动修改与AI辅助操作。系统采用锁定机制,确保先前决策被保留,后续编辑仅影响指定区域或属性。用户全程参与决策验证,系统使用差分更新而非全图重生成,降低生成漂移。对比实验表明,用户对Creo生成结果拥有更强所有权感,能清晰追溯自身决策路径。嵌入分析显示,Creo输出比单次生成结果更具多样性。结果表明,结合多阶段生成、中间控制与决策锁定,是提升可控性、用户自主性、创造力与输出多样性的关键设计原则。
原文摘要 · Abstract (English)
Text-to-image (T2I) systems enable rapid generation of high-fidelity imagery but are misaligned with how visual ideas develop. T2I systems generate outputs that make implicit visual decisions on behalf of the user, often introduce fine-grained details that can anchor users prematurely and limit their ability to keep options open early on, and cause unintended changes during editing that are difficult to correct and reduce users' sense of control. To address these concerns, we present Creo, a multi-stage T2I system that scaffolds image generation by progressing from rough sketches to high-resolution outputs, exposing intermediary abstractions where users can make incremental changes. Sketch-like abstractions invite user editing and allow users to keep design options open when ideas are still forming due to their provisional nature. Each stage in Creo can be modified with manual changes and AI-assisted operations, enabling fine-grained, step-wise control through a locking mechanism that preserves prior decisions so subsequent edits affect only specified regions or attributes. Users remain in the loop, making and verifying decisions across stages, while the system applies diffs instead of regenerating full images, reducing drift as fidelity increases. A comparative study with a one-shot baseline shows that participants felt stronger ownership over Creo outputs, as they were able to trace their decisions in building up the image. Furthermore, embedding-based analysis indicates that Creo outputs are less homogeneous than one-shot results. These findings suggest that multi-stage generation, combined with intermediate control and decision locking, is a key design principle for improving controllability, user agency, creativity, and output diversity in generative systems.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。