arXiv:2605.25861cs.CVcs.AI2026-05

提出联合恢复人体网格与穿衣人体重建的新模型,提升两者精度

MuNet: A Mutualistic Network for Joint 3D Human Mesh Recovery and 3D Clothed Human Reconstruction from Single Images

论文配图:MuNet: A Mutualistic Network for Joint 3D Human Mesh Recovery and 3D Clothed Human Reconstruction from Single Images
图 1 · 摘自论文原文
  • 用统一的2-流形图表示人体网格与穿衣模型,实现一致建模
  • 端到端图卷积网络逐步生成并细化3D人体与衣物细节
  • 双向交互机制让两个任务互相优化,适合高精度3D人体重建研究

3D人体网格恢复与3D穿衣人体重建本质相关,但长期被孤立研究,错失联合优化潜力。为此,我们提出统一框架,实现两任务协同。首先,采用2-流形图作为所有3D模型的统一表示,确保建模一致性。其次,设计端到端图卷积网络,逐步将初始图变形为3D人体网格,并精细化为带衣物的3D模型。第三,引入互惠机制,在训练中实现双向反馈:人体网格恢复为穿衣重建提供指导,穿衣重建反馈优化人体网格。我们在6个基准数据集(Human3.6M、3DPW、MPI-INF-3DHP、THuman2.0、CAPE、RenderPeople)上评估,结果表明MuNet在所有数据集上均达到当前最优性能。代码已开源。

原文摘要 · Abstract (English)

3D human mesh recovery and 3D clothed human reconstruction are inherently related, yet they have long been studied in isolation, thereby overlooking the potential gains of joint optimization. To overcome this limitation, we propose to address these two tasks within a unified framework, which allows their mutual dependencies to be effectively exploited. Building on this idea, we propose MuNet, a mutualistic network for joint 3D human mesh recovery and 3D clothed human reconstruction from single images. First, we adopt 2-manifold graphs as a unified representation for all 3D models, enabling consistent modeling across 3D human mesh recovery and clothed human reconstruction. Second, we design an end-to-end graph convolutional network that progressively deforms an initial graph into a 3D human mesh and refines it into a detailed 3D clothed human model. Third, we introduce a mutualistic mechanism that allows reciprocal interaction between the two tasks {during training}, where 3D human mesh recovery provides guidance for 3D clothed human reconstruction, and reconstruction feedback refines the 3D human mesh recovery. We extensively evaluate MuNet on six benchmark datasets for 3D human mesh recovery and 3D clothed human reconstruction, including Human3.6M, 3DPW, MPI-INF-3DHP, THuman2.0, CAPE, and RenderPeople. Experimental results demonstrate that MuNet achieves state-of-the-art performance on both tasks across all datasets. The code of MuNet is released for research purposes at https://github.com/starVisionTeam/MuNet.

3D人体重建图神经网络联合优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。