让AI生成的提示词可追溯,提升场景设计中图像精修的可控性
GenTune: Toward Traceable Prompts to Improve Controllability of Image Refinement in Environment Design
- 通过可追踪的提示标签,将图像元素与对应提示关联
- 实测提升设计师对提示-图像的理解度与修改效率(均p<0.01)
- 适合需要精细控制且保持整体一致性的游戏/影视场景设计
娱乐行业环境设计师需创作兼具细节控制与全局一致性的2D/3D场景。当前常借助大语言模型扩展文本提示并配合局部修复(inpainting)进行迭代优化,但我们的10位设计师访谈发现:一是长篇提示难以定位需修改的关键词;二是inpainting虽支持局部修改,却易破坏整体一致性。为此提出GenTune,使设计师可点击图像中任一元素,追溯其对应的提示标签并精准修改,实现精确又全局一致的图像优化。20位设计师的总结性研究显示,相比现有流程,GenTune显著提升提示-图像理解、修正质量与效率,满意度亦显著更高(所有p < .01)。两家工作室的实地跟进研究进一步验证了其在真实工作流中的有效性。
原文摘要 · Abstract (English)
Environment designers in the entertainment industry create imaginative 2D and 3D scenes for games, films, and television, requiring both fine-grained control of specific details and consistent global coherence. Designers have increasingly integrated generative AI into their workflows, often relying on large language models (LLMs) to expand user prompts for text-to-image generation, then iteratively refining those prompts and applying inpainting. However, our formative study with 10 designers surfaced two key challenges: (1) the lengthy LLM-generated prompts make it difficult to understand and isolate the keywords that must be revised for specific visual elements; and (2) while inpainting supports localized edits, it can struggle with global consistency and correctness. Based on these insights, we present GenTune, an approach that enhances human--AI collaboration by clarifying how AI-generated prompts map to image content. Our GenTune system lets designers select any element in a generated image, trace it back to the corresponding prompt labels, and revise those labels to guide precise yet globally consistent image refinement. In a summative study with 20 designers, GenTune significantly improved prompt--image comprehension, refinement quality, and efficiency, and overall satisfaction (all $p < .01$) compared to current practice. A follow-up field study with two studios further demonstrated its effectiveness in real-world settings.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。