用二维投影快速生成任意3D物体动画,速度快质量高。
AnimaSpark: A Feed-Forward Method for Animating Arbitrary 3D Objects

- 通过2D骨骼投影建模关键运动,简化3D动画生成
- 在多个指标上优于现有方法,推理速度更快
- 适合需要快速批量生成3D动画的开发者和设计师
尽管生成式AI已大幅加速静态3D模型创建流程,但类别无关的3D动画合成仍是3D资产生产中的主要瓶颈。当前方法在推理速度、动作质量及文本提示遵循度方面存在显著局限,仍依赖大量人工操作。为此,本文提出AnimaSpark,一种全新的类别无关3D动画生成管道。其核心思想是:许多基本3D运动对应的关节变换可有效建模于二维子空间中。该方法首先将带绑定的静态3D模型渲染为多层图像表示(网格与骨架),输入视频生成模型;随后利用关键点追踪算法捕获生成视频中骨骼关节在摄像机视平面内的运动轨迹;最后将这些追踪得到的平面平移与旋转信息从2D域还原至3D空间,完成角色动画。综合评估表明,本方法在文本-动作对齐度、运动质量及计算效率等关键指标上均优于现有最先进方法。
原文摘要 · Abstract (English)
While recent advancements in generative AI have substantially accelerated static 3D model creation workflows, the synthesis of category-agnostic 3D animations remains a significant bottleneck in 3D asset production. Current methods for category-agnostic animation generation exhibit critical limitations in inference speed, motion quality, and adherence to textual prompts, thereby leaving the process dependent on labor-intensive manual artistry. To address these challenges, this paper introduces AnimaSpark, a novel pipeline for category-agnostic 3D animation generation. Our approach is motivated by the key insight that for many fundamental motions in the 3D world, the corresponding joint transformations can often be effectively modeled within a two-dimensional subspace. The pipeline begins by rendering a rigged static 3D model into multi-layered image representations of its mesh and skeleton, which are subsequently fed into a video generation model. We then employ a keypoint tracking algorithm on the generated video to capture the motion of the skeletal joints projected onto the camera's viewing plane. In the final stage, we distill the planar translations and rotations from these tracked keypoints and lift them from the 2D domain into 3D space to animate the character. Comprehensive evaluations reveal that our method achieves superior performance over existing state-of-the-art techniques across key metrics, including text-motion alignment, quality of motion, and computational efficiency.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。