arXiv:2603.14772cs.CV2026-03中稿 · CVPR被引 2

仅用一张图生成能动且有布料动态的3D虚拟人

Zero-Shot Reconstruction of Animatable 3D Avatars with Cloth Dynamics from a Single Image

  • 用Transformer直接预测动态3D高斯变形,无需针对个体优化
  • 在动态数据上用轻量LoRA微调,实现静态到动态的知识迁移
  • 新提出的光流引导损失提升布料运动的真实感,适合虚拟试衣等场景

现有单图像3D人体建模方法主要依赖刚性关节变换,难以模拟真实布料动态。本文提出DynaAvatar,一个零样本框架,可从单张图像重建具备运动相关布料动态的可动画3D虚拟人。该模型基于大规模多人运动数据训练,采用基于Transformer的前馈架构,直接预测动态3D高斯变形,无需特定主体优化。为解决动态捕获数据稀缺问题,提出静态到动态的知识迁移策略:在大规模静态捕获数据上预训练的Transformer提供强几何与外观先验,通过轻量级LoRA微调高效适配至动态变形。进一步提出DynaFlow损失,一种基于光流引导的目标函数,在渲染空间中为布料动态提供可靠的运动方向几何线索。最后,重新标注了现有动态捕获数据集中缺失或噪声严重的SMPL-X拟合结果,因多数公开动态捕获数据集包含不完整或不可靠的拟合,不适合训练高质量3D虚拟人重建模型。实验表明,DynaAvatar生成的动画视觉丰富且泛化能力强,优于现有方法。

原文摘要 · Abstract (English)

Existing single-image 3D human avatar methods primarily rely on rigid joint transformations, limiting their ability to model realistic cloth dynamics. We present DynaAvatar, a zero-shot framework that reconstructs animatable 3D human avatars with motion-dependent cloth dynamics from a single image. Trained on large-scale multi-person motion datasets, DynaAvatar employs a Transformer-based feed-forward architecture that directly predicts dynamic 3D Gaussian deformations without subject-specific optimization. To overcome the scarcity of dynamic captures, we introduce a static-to-dynamic knowledge transfer strategy: a Transformer pretrained on large-scale static captures provides strong geometric and appearance priors, which are efficiently adapted to motion-dependent deformations through lightweight LoRA fine-tuning on dynamic captures. We further propose the DynaFlow loss, an optical flow-guided objective that provides reliable motion-direction geometric cues for cloth dynamics in rendered space. Finally, we reannotate the missing or noisy SMPL-X fittings in existing dynamic capture datasets, as most public dynamic capture datasets contain incomplete or unreliable fittings that are unsuitable for training high-quality 3D avatar reconstruction models. Experiments demonstrate that DynaAvatar produces visually rich and generalizable animations, outperforming prior methods.

3D虚拟人布料模拟单图重建零样本

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。