SAM 3D Body在人体形态细节重建上存在系统性偏差,难以还原特殊生理状态下的真实体型。
Investigating Anthropometric Fidelity in SAM 3D Body
- 通过分析低维参数化骨架与语义不变条件的结合机制,揭示了形态失真根源。
- 在老年肌萎缩、脊柱侧弯等明显生理变化下,重建结果仍趋向平均体型。
- 提出混合表征与医学闭环对齐等方向,推动模型向医疗高精度应用拓展。
SAM 3D Body 是近期在人体网格恢复领域的重要进展,能从单图生成拓扑连贯、干净的人体网格。其通过动量人体骨骼(MHR)实现对遮挡和复杂姿态的鲁棒性。然而,我们的评估发现该模型存在特定且一致的局限:在输入图像中明显呈现的个体化生理形变(如老年肌萎缩、脊柱侧弯、妊娠状态)仍难以被准确重建。本文不将此视为模型能力不足,而是归因于“感知-失真权衡”效应。我们指出,其架构依赖低维参数化MHR表示,结合语义不变条件(DINOv3)与标注对齐,导致普遍的“回归均值”现象。通过分析这些机制,揭示了生物个体特征为何被平滑。此外,本文提出未来改进路径,如隐式-显式混合表示和医学闭环对齐,以提升SAM 3D Body在高精度医疗场景中的表现。
原文摘要 · Abstract (English)
The release of SAM 3D Body is a recent development in human mesh recovery, demonstrating improved performance in producing clean, topologically coherent meshes from single images. By leveraging the Momentum Human Rig (MHR), it achieves robustness to occlusion and diverse poses. However, our evaluation reveals a specific and consistent limitation: the model struggles to reconstruct detailed anthropometric deviations, particularly in populations exhibiting distinctive morphological alterations such as geriatric muscle atrophy, scoliosis, or pregnancy, even when these features are prominent in the input image. In this paper, we investigate this phenomenon not as a failure of the model's capacity, but as a byproduct of the "perception-distortion trade-off". We posit that the architectural reliance on the low-dimensional parametric MHR representation, combined with semantic-invariant conditioning (DINOv3) and annotation-based alignment, creates a pervasive "regression to the mean" effect. We analyze these mechanisms to understand why individual biological details are smoothed out. Furthermore, we state our contributions by proposing specific, constructive pathways for future work, such as implicit-explicit hybrid representations and Medical-in-the-Loop alignment, to extend the baseline performance of SAM 3D Body into the high-precision medical domain.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。