用文本驱动3D动画,动作更自然流畅,细节更丰富。
Animus3D: Text-driven 3D Animation via Motion Score Distillation
- 用运动评分蒸馏替代传统方法,提升动作生成质量。
- 生成动作比现有方法更明显且无抖动,保持外观一致性。
- 适合需要高质量3D角色动画的创作者或游戏开发者。
我们提出 Animus3D,一个基于文本驱动的3D动画框架,可根据静态3D资产和文本提示生成运动场。以往方法多采用原始分数蒸馏采样(SDS)从预训练文本到视频扩散模型中蒸馏运动,导致动画动作微弱或出现明显抖动。为解决此问题,我们提出一种新方法——运动评分蒸馏(MSD)。具体地,引入增强型LoRA视频扩散模型,以静态源分布代替SDS中的纯噪声;同时结合基于反演的噪声估计技术,确保运动引导下的外观保持。为进一步提升运动保真度,加入显式的时空正则化项,缓解时间与空间中的几何畸变。此外,设计运动精修模块,提升时间分辨率并增强细粒度细节,突破底层视频模型的固定分辨率限制。大量实验表明,Animus3D能从多样化文本提示成功为静态3D资产生成显著更丰富、更精细的动作,同时保持高视觉完整性。代码将发布于 https://qiisun.github.io/animus3d_page。
原文摘要 · Abstract (English)
We present Animus3D, a text-driven 3D animation framework that generates motion field given a static 3D asset and text prompt. Previous methods mostly leverage the vanilla Score Distillation Sampling (SDS) objective to distill motion from pretrained text-to-video diffusion, leading to animations with minimal movement or noticeable jitter. To address this, our approach introduces a novel SDS alternative, Motion Score Distillation (MSD). Specifically, we introduce a LoRA-enhanced video diffusion model that defines a static source distribution rather than pure noise as in SDS, while another inversion-based noise estimation technique ensures appearance preservation when guiding motion. To further improve motion fidelity, we incorporate explicit temporal and spatial regularization terms that mitigate geometric distortions across time and space. Additionally, we propose a motion refinement module to upscale the temporal resolution and enhance fine-grained details, overcoming the fixed-resolution constraints of the underlying video model. Extensive experiments demonstrate that Animus3D successfully animates static 3D assets from diverse text prompts, generating significantly more substantial and detailed motion than state-of-the-art baselines while maintaining high visual integrity. Code will be released at https://qiisun.github.io/animus3d_page.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。