arXiv:2512.17545cs.CVcs.AI2025-12被引 1

从单图精准还原穿各种衣服的人体3D网格,适合虚拟试衣场景。

ClothHMR: 3D Mesh Recovery of Humans in Diverse Clothing from Single Image

  • 用服装贴合人体轮廓的方法减轻衣物干扰,提升重建精度。
  • 在多个数据集上显著优于现有方法,野外图像表现也优秀。
  • 结合大模型视觉信息,适合真实世界应用如在线试衣。

随着3D数据成为重要多媒体信息形式,3D人体网格恢复技术迅速发展。然而,现有方法主要针对紧身衣物,对多样服装尤其是宽松衣物的还原效果较差。为此,本文提出两个关键洞察:(1) 将衣物贴合人体可缓解衣物对3D重建的负面影响;(2) 利用大模型的人体视觉信息可增强估计泛化能力。基于此,提出ClothHMR,包含服装贴合(CT)与基于大模型视觉表征的网格恢复(MR)模块。CT模块通过人体语义分割与边缘预测实现衣物贴合;MR模块通过持续对齐3D网格中间表示与大模型推断的表征来优化初始参数。实验表明,ClothHMR在多个基准数据集及野外图像上显著优于现有先进方法。此外,开发了基于ClothHMR的在线时尚购物应用,验证其真实场景适用性。代码与模型已开源。

原文摘要 · Abstract (English)

With 3D data rapidly emerging as an important form of multimedia information, 3D human mesh recovery technology has also advanced accordingly. However, current methods mainly focus on handling humans wearing tight clothing and perform poorly when estimating body shapes and poses under diverse clothing, especially loose garments. To this end, we make two key insights: (1) tailoring clothing to fit the human body can mitigate the adverse impact of clothing on 3D human mesh recovery, and (2) utilizing human visual information from large foundational models can enhance the generalization ability of the estimation. Based on these insights, we propose ClothHMR, to accurately recover 3D meshes of humans in diverse clothing. ClothHMR primarily consists of two modules: clothing tailoring (CT) and FHVM-based mesh recovering (MR). The CT module employs body semantic estimation and body edge prediction to tailor the clothing, ensuring it fits the body silhouette. The MR module optimizes the initial parameters of the 3D human mesh by continuously aligning the intermediate representations of the 3D mesh with those inferred from the foundational human visual model (FHVM). ClothHMR can accurately recover 3D meshes of humans wearing diverse clothing, precisely estimating their body shapes and poses. Experimental results demonstrate that ClothHMR significantly outperforms existing state-of-the-art methods across benchmark datasets and in-the-wild images. Additionally, a web application for online fashion and shopping powered by ClothHMR is developed, illustrating that ClothHMR can effectively serve real-world usage scenarios. The code and model for ClothHMR are available at: \url{https://github.com/starVisionTeam/ClothHMR}.

3D重建人体建模虚拟试衣

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。