人类通过不断修改提示词,能逐步还原目标图像。
A Picture is Worth a Thousand Prompts? Efficacy of Iterative Human-Driven Prompt Refinement in Image Regeneration Tasks
- 让人类反复调整提示词,尝试复现指定图像。
- 改进后的图像与目标图像的相似度显著提升。
- 适合关注生成式AI交互优化的研究者
随着AI生成内容在网页、社交媒体等数字平台日益普遍,研究其生成过程的启发机制至关重要。本文聚焦于相对较新的图像再生任务:人类操作员通过迭代优化提示词,力求精确复现特定目标图像。与无参照的常规图像生成不同,图像再生依赖明确的视觉参考。同时,现有图像相似性度量(ISMs)是否能提供可靠客观反馈仍存疑问,因为尚不清楚人类主观相似性判断是否与这些度量一致。为此,我们开展结构化用户研究,评估迭代提示词优化对再生图像与目标图像相似度的影响,并检验ISMs是否捕捉到人类观察者感知到的改善。结果表明,渐进式提示调整显著提升图像匹配度,且主观评价与量化指标均验证了这一趋势,凸显了迭代工作流在提升生成式AI内容创作中的广泛潜力。
原文摘要 · Abstract (English)
With AI-generated content becoming ubiquitous across the web, social media, and other digital platforms, it is vital to examine how such content are inspired and generated. The creation of AI-generated images often involves refining the input prompt iteratively to achieve desired visual outcomes. This study focuses on the relatively underexplored concept of image regeneration using AI, in which a human operator attempts to closely recreate a specific target image by iteratively refining their prompt. Image regeneration is distinct from normal image generation, which lacks any predefined visual reference. A separate challenge lies in determining whether existing image similarity metrics (ISMs) can provide reliable, objective feedback in iterative workflows, given that we do not fully understand if subjective human judgments of similarity align with these metrics. Consequently, we must first validate their alignment with human perception before assessing their potential as a feedback mechanism in the iterative prompt refinement process. To address these research gaps, we present a structured user study evaluating how iterative prompt refinement affects the similarity of regenerated images relative to their targets, while also examining whether ISMs capture the same improvements perceived by human observers. Our findings suggest that incremental prompt adjustments substantially improve alignment, verified through both subjective evaluations and quantitative measures, underscoring the broader potential of iterative workflows to enhance generative AI content creation across various application domains.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。