arXiv:2604.28025cs.CV2026-04

首个可重建残肢表面的单图3D人体建模方法,适配截肢人群。

ResiHMR: Residual-Limb Aware Single-Image 3D Human Mesh Recovery for Individuals with Limb Loss

论文配图:ResiHMR: Residual-Limb Aware Single-Image 3D Human Mesh Recovery for Individuals with Limb Loss
图 1 · 摘自论文原文
  • 引入残肢关键点与拓扑自适应优化模块,匹配非标准肢体结构
  • 残肢边界与凸终止几何显式重建,2D MPJPE降低至23.19
  • 适用于假肢生物力学研究与康复应用,填补领域空白

单图人体网格重建为紧凑的3D人中心表示,支持分析、动画、AR/VR、康复及人机交互。然而现有系统依赖完整肢体先验,在截肢人群中表现下降,因固定拓扑模型无法表征残肢。本文提出ResiHMR,一种面向截肢人群的残肢感知单图3D人体建模框架。该框架引入残肢关键点,设计两个组件:(i) 拓扑自适应残肢锚点优化模块,约束估计至解剖学有效结构的观测运动链;(ii) 基于几何的残肢重建模块,显式估计残肢边界与凸终止几何。这些组件引入拓扑感知优化与显式终止几何,用于非标准肢体结构的人体网格重建。相比固定拓扑中移除关节的方法,ResiHMR显式重建残肢表面,并使优化对齐截肢拓扑,更契合假肢生物力学与实际应用。据我们所知,这是首个显式重建残肢表面并进行拓扑自适应优化的单图人体建模系统。在自建的真实世界截肢图像数据集上,ResiHMR在SMPLify-X与HSMR骨干网络下均提升重建质量,完整关节2D MPJPE从41.32降至37.40,残肢2D MPJPE从73.61降至23.19。

原文摘要 · Abstract (English)

Single-image human mesh recovery provides a compact 3D, person-centric representation that supports analysis, animation, AR and VR, rehabilitation, and human-computer interaction. However, prevailing systems impose an intact-limb prior and degrade on people with limb loss, because fixed-topology models cannot represent residual limbs. In this work, we present ResiHMR, a residual-limb aware framework for single-image 3D human modeling. ResiHMR adopts residual-limb keypoints and introduces two components: (i) a topology-adaptive Residual Anchor-Factor Optimization module that constrains estimation to the observed kinematic subgraph of anatomically valid structures, and (ii) a geometry-based Residual-Limb Reconstruction module that estimates residual-limb boundaries and convex limb-termination geometry. These components introduce topology-aware optimization and explicit termination geometry as tools for human mesh recovery under non-standard limb anatomy. Unlike joint-removal methods in a fixed topology, ResiHMR explicitly reconstructs residual-limb surfaces and aligns optimization with limb-loss topology, which better matches prosthetic biomechanics and real-world use. To the best of our knowledge, this is the first single-image HMR system that explicitly reconstructs residual-limb surfaces and performs topology-adaptive optimization for individuals with limb loss. On a curated dataset of real-world images with limb loss, ResiHMR improves reconstruction quality under both SMPLify-X and HSMR backbones, reducing intact-joint 2D MPJPE from 41.32 to 37.40 with SMPLify-X and residual-limb 2D MPJPE from 73.61 to 23.19 with HSMR.

3D人体建模截肢重建残肢感知单图重建

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。