从少至4张图像重建服装拓扑与缝线,支持高保真物理仿真。
ReWeaver: Towards Simulation-Ready and Topology-Accurate Garment Reconstruction
- 基于多视角图像预测2D/3D缝线与板片连接关系
- 在10万+合成样本上训练,拓扑准确率显著领先
- 适合数字人、虚拟试穿与机器人操作场景
高质量3D服装重建对缩小数字人、虚拟试穿和机器人操作中的模拟到现实差距至关重要。然而现有方法通常依赖无结构表示(如3D高斯泼溅),难以准确还原服装拓扑与缝制结构,导致重建结果不适于高保真物理仿真。本文提出ReWeaver,一种从稀疏多视角RGB图像中重建拓扑精确的3D服装与缝制图的新框架。仅需4张输入图像,ReWeaver即可预测缝线、板片及其在2D UV空间与3D空间中的连通性,使预测结果精准对齐多视角图像,生成适用于3D感知、高保真物理仿真与机器人操作的结构化2D-3D服装表示。为支持有效训练,构建大规模数据集GCD-TS,包含超过10万张合成样本,覆盖多种复杂几何与拓扑。大量实验表明,ReWeaver在拓扑准确性、几何对齐度与缝线-板片一致性方面持续优于现有方法。
原文摘要 · Abstract (English)
High-quality 3D garment reconstruction plays a crucial role in mitigating the sim-to-real gap in applications such as digital avatars, virtual try-on and robotic manipulation. However, existing garment reconstruction methods typically rely on unstructured representations, such as 3D Gaussian Splats, struggling to provide accurate reconstructions of garment topology and sewing structures. As a result, the reconstructed outputs are often unsuitable for high-fidelity physical simulation. We propose ReWeaver, a novel framework for topology-accurate 3D garment and sewing pattern reconstruction from sparse multi-view RGB images. Given as few as four input views, ReWeaver predicts seams and panels as well as their connectivities in both the 2D UV space and the 3D space. The predicted seams and panels align precisely with the multi-view images, yielding structured 2D--3D garment representations suitable for 3D perception, high-fidelity physical simulation, and robotic manipulation. To enable effective training, we construct a large-scale dataset GCD-TS, comprising multi-view RGB images, 3D garment geometries, textured human body meshes and annotated sewing patterns. The dataset contains over 100,000 synthetic samples covering a wide range of complex geometries and topologies. Extensive experiments show that ReWeaver consistently outperforms existing methods in terms of topology accuracy, geometry alignment and seam-panel consistency.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。