让AI只生成物体的某一部分,快速制作原型设计。
PartStickers: Generating Parts of Objects for Rapid Prototyping
- 提出局部部件生成新任务,输出孤立部件图像。
- 在真实感和文本对齐上优于现有方法。
- 适合游戏、产品设计等需要快速迭代的场景。
设计原型需创建产品或概念的模拟模型以获取反馈并迭代想法。尽管原型常需特定物体部件(如为视频游戏设计新生物),现有文本到图像方法多仅生成完整物体。为此,我们提出全新的「部件贴纸生成」任务与方法,即在中性背景上生成物体的孤立部件。实验表明,该方法在真实感和文本对齐方面优于当前最先进基线,同时保留了整体物体生成能力。代码与模型已公开,以推动社区在此新任务上的进展:https://partsticker.github.io。
原文摘要 · Abstract (English)
Design prototyping involves creating mockups of products or concepts to gather feedback and iterate on ideas. While prototyping often requires specific parts of objects, such as when constructing a novel creature for a video game, existing text-to-image methods tend to only generate entire objects. To address this, we propose a novel task and method of ``part sticker generation", which entails generating an isolated part of an object on a neutral background. Experiments demonstrate our method outperforms state-of-the-art baselines with respect to realism and text alignment, while preserving object-level generation capabilities. We publicly share our code and models to encourage community-wide progress on this new task: https://partsticker.github.io.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。