用虚拟骨骼+神经网络实现每秒300帧的逼真服装动态模拟。
HyperBones: Realtime Bone-driven Neural Garment Simulation with Hypernetwork Conditioning

- 分粗细两级神经网络,骨骼驱动服装大动作,卷积网络恢复褶皱细节。
- 无需外部物理引擎,在300+帧/秒下保持真实服装动态效果。
- 支持多种体型和动作,适合游戏、VR等实时交互场景。
近期服装模拟进展使高质量结果接近实时性能。基于物理的模拟器虽准确但计算成本高,难以用于交互应用;线性混合皮肤法效率高,却无法捕捉宽松服装的复杂动态,常导致不自然运动和视觉伪影。神经方法虽有潜力,但在严格运行时延约束下仍难以实现逼真松垮服装动画。本文提出一种快速且物理合理的动态服装模拟方法:训练一个由粗细两级组件构成的降维神经动力学模拟器。粗粒度层级通过集成轻量神经网络的虚拟骨骼驱动服装,细粒度褶皱则由训练好的卷积神经图恢复。通过解耦身份特异性计算与实时神经整合,该架构在保持高性能的同时支持多样体形与动作。我们还引入有效的物理监督机制,使结果准确且无需依赖外部模拟器。实验表明,本方法能生成物理合理服装动态,泛化于多种动作与体形,并支持一组固定服装。模拟器在消费级GPU上达到300+帧/秒,适用于实时应用。
原文摘要 · Abstract (English)
Recent advances in garment simulation have brought high-quality results closer to real-time performance. Physics-based simulators can produce accurate motion, but remain too computationally expensive for interactive applications. In contrast, linear blend skinning is efficient, but cannot capture the complex dynamics of loose-fitting garments, often leading to unrealistic motion and visual artifacts. Neural methods offer a promising alternative, yet they still struggle to animate loose clothing plausibly under strict runtime constraints. We present a fast and physically plausible approach for dynamic garment simulation. Our method trains a reduced-space neural dynamics simulator composed of independent coarse- and fine-level components. At the coarse level, the garment is driven by a set of virtual bones integrated with a lightweight neural network. Fine-scale wrinkle details are then recovered using a trained convolutional neural map. By decoupling identity-specific computation from real-time neural integration, our architecture maintains high performance while supporting diverse body shapes and motions. We further introduce an effective physics-supervision scheme that enables accurate results without relying on an external simulator. Experiments show that our method produces physically plausible garment dynamics, generalizes across a range of motions and body shapes, and supports a fixed set of garments. Our simulator runs at 300+ FPS on a commodity GPU, making it suitable for real-time applications.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。