首个基于3D渲染的2D动画光流数据集，助力动漫视频生成与上色研究
LinkTo-Anime: A 2D Animation Optical Flow Dataset from 3D Model Rendering
- 用3D模型渲染生成动漫角色运动，模拟真实手绘动画特性
- 包含24,230帧训练、720帧验证和4,320帧测试数据，标注光流与遮挡信息
- 专为动漫生成与着色任务设计，适合动画生成与视觉算法研究者
现有光流数据集主要聚焦于真实世界模拟或合成人体运动，但针对手绘动画（cel anime）角色运动的数据集极少，而该领域具有独特的视觉与运动特征。为填补这一空白并推动光流估计及下游任务（如动漫视频生成、线稿着色）的研究，我们提出LinkTo-Anime，首个专门基于3D模型渲染生成的高质量2D动画光流数据集。该数据集涵盖395个视频序列，总计24,230帧训练数据、720帧验证数据和4,320帧测试数据，提供前向与后向光流、遮挡掩码及Mixamo骨骼标注。同时构建了涵盖多种光流估计算法的综合基准，用于分析跨数据集的性能瓶颈与局限性。
原文摘要 · Abstract (English)
Existing optical flow datasets focus primarily on real-world simulation or synthetic human motion, but few are tailored to Celluloid(cel) anime character motion: a domain with unique visual and motion characteristics. To bridge this gap and facilitate research in optical flow estimation and downstream tasks such as anime video generation and line drawing colorization, we introduce LinkTo-Anime, the first high-quality dataset specifically designed for cel anime character motion generated with 3D model rendering. LinkTo-Anime provides rich annotations including forward and backward optical flow, occlusion masks, and Mixamo Skeleton. The dataset comprises 395 video sequences, totally 24,230 training frames, 720 validation frames, and 4,320 test frames. Furthermore, a comprehensive benchmark is constructed with various optical flow estimation methods to analyze the shortcomings and limitations across multiple datasets.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品；中文卡片由大模型生成，请以原文为准。