MangaNinja精准匹配参考图,实现漫画线稿自动上色。
MangaNinja: Line Art Colorization with Precise Reference Following
- 通过打乱图像块增强参考图与线稿的对应学习
- 利用点控机制实现精细色彩匹配,准确率显著提升
- 支持跨角色配色和多参考融合,适合复杂场景
基于扩散模型,MangaNinja专注于参考引导的线稿上色任务。设计了两种创新机制:一是图像块打乱模块,促进参考色图与目标线稿之间的对应关系学习;二是点驱动控制方案,实现细粒度色彩匹配。在自建基准数据集上的实验表明,该模型在精确上色方面优于现有方法。进一步验证了交互式点控在处理复杂案例、跨角色配色及多参考融合方面的潜力,突破了现有算法的能力边界。
原文摘要 · Abstract (English)
Derived from diffusion models, MangaNinjia specializes in the task of reference-guided line art colorization. We incorporate two thoughtful designs to ensure precise character detail transcription, including a patch shuffling module to facilitate correspondence learning between the reference color image and the target line art, and a point-driven control scheme to enable fine-grained color matching. Experiments on a self-collected benchmark demonstrate the superiority of our model over current solutions in terms of precise colorization. We further showcase the potential of the proposed interactive point control in handling challenging cases, cross-character colorization, multi-reference harmonization, beyond the reach of existing algorithms.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。