一键自动为多物体线稿上色,保持风格一致且无需手动调整。
Follow-Your-Color: Multi-Instance Sketch Colorization
- 采用自博弈训练和实例引导机制,解决多实例上色数据不足问题。
- 单次前向传播完成全部上色,颜色匹配精度显著优于现有方法。
- 适合美术新手快速生成风格统一的彩色线稿作品。
我们提出 Follow-Your-Color,一种基于扩散模型的多实例线稿上色框架。2D 线稿上色在工业流程中包含角色设计、逐个对象着色与精修三个关键阶段,传统方式需艺术家逐一重复上色,效率低且易出错。现有生成方法因难以收集多实例成对数据而无法有效解决此任务。为此,我们设计三项关键技术:首先提出自博弈训练策略缓解训练数据稀缺问题;其次引入实例引导模块注入目标颜色信息;最后采用细粒度颜色匹配结合边缘损失提升视觉质量。所提方法可在单次前向传播中实现多实例线稿的自动上色,生成色彩精准、风格一致的图像。在自建数据集上的实验表明,该模型在色相精度方面超越现有方法,支持新手仅通过提供参考实例与原始线稿即可零手动调整生成连贯艺术作品。代码与更多细节见 https://yinhan-zhang.github.io/color。
原文摘要 · Abstract (English)
We present Follow-Your-Color, a diffusion-based framework for multi-instance sketch colorization. The production of multi-instance 2D line art colorization adheres to an industry-standard workflow, which consists of three crucial stages: the design of line art characters, the coloring of individual objects, and the refinement process. The artists are required to repeat the process of coloring each instance one by one, which is inaccurate and inefficient. Meanwhile, current generative methods fail to solve this task due to the challenge of multi-instance pair data collection. To tackle these challenges, we incorporate three technical designs to ensure precise character detail transcription and achieve multi-instance sketch colorization in a single forward pass. Specifically, we first propose the self-play training strategy to address the lack of training data. Then we introduce an instance guider to feed the color of the instance. To achieve accurate color matching, we present fine-grained color matching with edge loss to enhance visual quality. Equipped with the proposed modules, Follow-Your-Color enables automatically transforming sketches into vividly-colored images with accurate consistency and multi-instance control. Experiments on our collected datasets show that our model outperforms existing methods regarding chromatic precision. Specifically, our model critically automates the colorization process with zero manual adjustments, so novice users can produce stylistically consistent artwork by providing reference instances and the original line art. Our code and additional details are available at https://yinhan-zhang.github.io/color.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。