arXiv:2501.01393cs.CVcs.GR2025-01NeurIPS被引 3

用布料轨迹学习物理规律,通用动画任意服装。

Learning 3D Garment Animation from Trajectories of A Piece of Cloth

  • 从布料轨迹中解耦出能量变化规律,无需物理先验
  • 预训练网络可直接优化能量实现稳定服装动画
  • 减少数据依赖,适合泛化到未见服装类型

服装动画广泛应用于虚拟现实、游戏和影视制作。近年来,基于学习的方法在多种场景下实现了出色的服装动画效果。然而,数据驱动方法需要大量服装数据,成本高且耗时;强制模型匹配观测服装的动力学,可能限制其对未见情况的泛化能力。本文提出一种解耦方案:1)从观测布料中学习本构行为;2)基于学习到的本构规律动态模拟各类服装。我们提出能量单元网络(EUNet),以能量形式建模本构关系。无需解析物理模型或可微仿真引擎,EUNet能直接从观测布料中捕捉本构行为,统一描述拉伸、弯曲等形变引起的能量变化。进一步,将预训练的EUNet用于约束各类服装的能量优化动画。该解耦策略减少了对服装数据的需求,并使单块布料的动态可用于动画生成。实验表明,尽管EUNet能有效输出形变导致的能量梯度,基于EUNet约束的模型相比传统服装监督训练,表现出更稳定、更符合物理的动画效果。代码已公开于https://github.com/ftbabi/EUNet_NeurIPS2024.git。

原文摘要 · Abstract (English)

Garment animation is ubiquitous in various applications, such as virtual reality, gaming, and film producing. Recently, learning-based approaches obtain compelling performance in animating diverse garments under versatile scenarios. Nevertheless, to mimic the deformations of the observed garments, data-driven methods require large scale of garment data, which are both resource-wise expensive and time-consuming. In addition, forcing models to match the dynamics of observed garment animation may hinder the potentials to generalize to unseen cases. In this paper, instead of using garment-wise supervised-learning we adopt a disentangled scheme to learn how to animate observed garments: 1). learning constitutive behaviors from the observed cloth; 2). dynamically animate various garments constrained by the learned constitutive laws. Specifically, we propose Energy Unit network (EUNet) to model the constitutive relations in the format of energy. Without the priors from analytical physics models and differentiable simulation engines, EUNet is able to directly capture the constitutive behaviors from the observed piece of cloth and uniformly describes the change of energy caused by deformations, such as stretching and bending. We further apply the pre-trained EUNet to animate various garments based on energy optimizations. The disentangled scheme alleviates the need of garment data and enables us to utilize the dynamics of a piece of cloth for animating garments. Experiments show that while EUNet effectively delivers the energy gradients due to the deformations, models constrained by EUNet achieve more stable and physically plausible performance comparing with those trained in garment-wise supervised manner. Code is available at https://github.com/ftbabi/EUNet_NeurIPS2024.git .

服装动画能量建模解耦学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。