arXiv:2508.00398cs.GRcs.CV2025-08ICCV被引 4

解决手绘3D动画中遮挡导致的风格失真问题,提升绘制风格一致性。

Occlusion-robust Stylization for Drawing-based 3D Animation

  • 用光流生成鲁棒边缘引导,应对动态遮挡带来的风格偏差。
  • 在遮挡场景下有效避免轮廓闪烁和笔触模糊,保持风格稳定。
  • 单次运行速度比两阶段方法快2.4倍,内存减少2.1倍,适合实时应用。

3D动画旨在从输入图像和目标3D运动序列生成3D动画视频。近年来,基于图像的3D模型已实现直接从用户手绘图生成动画。与传统3D动画不同,手绘3D动画需保留艺术家的独特风格特征,如粗略轮廓和独特笔触模式。然而,现有方法在身体部件重叠导致的遮挡情况下仍出现风格质量下降,表现为轮廓闪烁和笔触模糊。其根源在于风格化网络在训练与推理间存在‘风格化姿态差距’:训练时使用无遮挡姿态,而推理时面对动态运动中的多样遮挡。为此,本文提出遮挡鲁棒风格化框架(OSF)。我们发现,虽物体边缘可作为有效引导,但在推理时遮挡会导致边缘不准确。因此,OSF利用光流提供遮挡鲁棒的边缘引导,确保风格化一致性。此外,OSF采用单阶段流程,相比以往两阶段方法,推理速度提升2.4倍,内存降低2.1倍。

原文摘要 · Abstract (English)

3D animation aims to generate a 3D animated video from an input image and a target 3D motion sequence. Recent advances in image-to-3D models enable the creation of animations directly from user-hand drawings. Distinguished from conventional 3D animation, drawing-based 3D animation is crucial to preserve artist's unique style properties, such as rough contours and distinct stroke patterns. However, recent methods still exhibit quality deterioration in style properties, especially under occlusions caused by overlapping body parts, leading to contour flickering and stroke blurring. This occurs due to a `stylization pose gap' between training and inference in stylization networks designed to preserve drawing styles in drawing-based 3D animation systems. The stylization pose gap denotes that input target poses used to train the stylization network are always in occlusion-free poses, while target poses encountered in an inference include diverse occlusions under dynamic motions. To this end, we propose Occlusion-robust Stylization Framework (OSF) for drawing-based 3D animation. We found that while employing object's edge can be effective input prior for guiding stylization, it becomes notably inaccurate when occlusions occur at inference. Thus, our proposed OSF provides occlusion-robust edge guidance for stylization network using optical flow, ensuring a consistent stylization even under occlusions. Furthermore, OSF operates in a single run instead of the previous two-stage method, achieving 2.4x faster inference and 2.1x less memory.

3D动画风格化遮挡处理光流

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。