用轻量网络从低分辨率布料模拟中生成高细节褶皱,适合手机等低算力设备。
Neural Garment Dynamic Super-Resolution
- 基于粗粒度布料动态和人体互动,用图神经网络提取超分辨率特征。
- 通过隐函数预测细粒度褶皱残差,显著提升高频率褶皱细节质量。
- 可迭代生成后续帧,适用于实时布料动画,泛化能力强。
由于计算成本高,实现高效、高保真、高分辨率的服装模拟极具挑战。相比之下,低分辨率模拟更易实现,适合智能手机等低预算设备。本文提出一种轻量级学习方法,用于服装动态超分辨率重建,旨在高效增强低分辨率服装模拟中的高分辨率、高频细节。该方法从低分辨率服装模拟与身体运动出发,利用网格-图神经网络(mesh-graph-net)基于粗粒度服装动态和衣体交互计算超分辨率特征,并通过超网络构建每个粗网格三角形的隐式函数以表示精细褶皱残差。考虑到粗略服装形状对褶皱表现的影响,先修正粗略服装形状,再利用这些隐函数预测详细褶皱残差,最终将残差应用于修正后的粗略网格,生成高分辨率细节几何。该方法支持滚动预测,将前一帧输出作为下一帧输入,实现连续帧间细粒度褶皱生成。尽管训练数据集较小,模型仍能良好泛化至未见的人体形态、动作及服装类型。实验表明,本方法在提升高频、细粒度褶皱细节方面显著优于现有主流方法。
原文摘要 · Abstract (English)
Achieving efficient, high-fidelity, high-resolution garment simulation is challenging due to its computational demands. Conversely, low-resolution garment simulation is more accessible and ideal for low-budget devices like smartphones. In this paper, we introduce a lightweight, learning-based method for garment dynamic super-resolution, designed to efficiently enhance high-resolution, high-frequency details in low-resolution garment simulations. Starting with low-resolution garment simulation and underlying body motion, we utilize a mesh-graph-net to compute super-resolution features based on coarse garment dynamics and garment-body interactions. These features are then used by a hyper-net to construct an implicit function of detailed wrinkle residuals for each coarse mesh triangle. Considering the influence of coarse garment shapes on detailed wrinkle performance, we correct the coarse garment shape and predict detailed wrinkle residuals using these implicit functions. Finally, we generate detailed high-resolution garment geometry by applying the detailed wrinkle residuals to the corrected coarse garment. Our method enables roll-out prediction by iteratively using its predictions as input for subsequent frames, producing fine-grained wrinkle details to enhance the low-resolution simulation. Despite training on a small dataset, our network robustly generalizes to different body shapes, motions, and garment types not present in the training data. We demonstrate significant improvements over state-of-the-art alternatives, particularly in enhancing the quality of high-frequency, fine-grained wrinkle details.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。