用动态传播机制让服装模拟模型跨分辨率通用,提升效率与适应性。
Pb4U-GNet: Resolution-Adaptive Garment Simulation via Propagation-before-Update Graph Network
- 先传信息再更新:消息传递深度随网格密度自适应调整。
- 训练仅用低分辨率数据,却能在高分辨率网格上保持高精度。
- 适合需要快速生成不同细节级别服装动画的虚拟试穿场景。
服装模拟在计算机视觉与图形学中应用广泛,如虚拟试穿和数字人建模。然而传统物理方法计算成本高,难以用于实时场景。尽管图神经网络(GNN)提供了加速可能,但现有方法在跨分辨率泛化方面表现不佳,在高于训练分布的高分辨率网格上性能显著下降。根源在于两点:(1) 现有GNN采用固定消息传递深度,无法适配网格密度变化;(2) 顶点位移幅度在服装模拟中本就与分辨率相关。为此,本文提出传播前更新图网络(Pb4U-GNet),通过解耦消息传播与特征更新实现分辨率自适应。该框架包含两个核心机制:(1) 动态传播深度控制,根据网格分辨率调整消息传递迭代次数;(2) 几何感知更新缩放,依据局部网格特征对预测结果进行缩放。大量实验表明,即使仅在低分辨率网格上训练,Pb4U-GNet也能在多种分辨率网格上表现出强泛化能力,解决了神经服装模拟中的根本挑战。
原文摘要 · Abstract (English)
Garment simulation is fundamental to various applications in computer vision and graphics, from virtual try-on to digital human modelling. However, conventional physics-based methods remain computationally expensive, hindering their application in time-sensitive scenarios. While graph neural networks (GNNs) offer promising acceleration, existing approaches exhibit poor cross-resolution generalisation, demonstrating significant performance degradation on higher-resolution meshes beyond the training distribution. This stems from two key factors: (1) existing GNNs employ fixed message-passing depth that fails to adapt information aggregation to mesh density variation, and (2) vertex-wise displacement magnitudes are inherently resolution-dependent in garment simulation. To address these issues, we introduce Propagation-before-Update Graph Network (Pb4U-GNet), a resolution-adaptive framework that decouples message propagation from feature updates. Pb4U-GNet incorporates two key mechanisms: (1) dynamic propagation depth control, adjusting message-passing iterations based on mesh resolution, and (2) geometry-aware update scaling, which scales predictions according to local mesh characteristics. Extensive experiments show that even trained solely on low-resolution meshes, Pb4U-GNet exhibits strong generalisability across diverse mesh resolutions, addressing a fundamental challenge in neural garment simulation.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。