从皮肤表面反推肌肉动态,实现低成本高精度虚拟人体建模
SOMA: From Surface Observations to Muscle Anatomy

- 通过多视角RGB图像反演肌肉时空变形,无需复杂物理模拟
- 首次实现从皮肤外观直接恢复肌肉结构变化,支持真实运动动画
- 适合影视、游戏、医疗等领域需要真实人体动力学的场景
随着对逼真虚拟人需求的增长,参数化人体模型已成为现代医学、体育和娱乐的核心。然而,现有模型大多仅捕捉皮肤表面三维形状,无法反映驱动动作的复杂生物力学结构。传统软组织仿真(如有限元法)虽精确但难以扩展,计算成本过高。现有生物力学工具可模拟肌肉力与激活,却无法建模外部形态变化,导致激活与实际解剖外观关联受限。为此,本文提出逆向研究问题:从可见表面观测(即皮肤与姿态)中恢复肌肉形变。我们提出SOMA(从表面观测到肌肉解剖),一种基于多视角RGB相机获取表面信号的人体特异性模型,并构建了SKIM——一个受试者特定的软组织形变数据集。据我们所知,这是首个尝试从多视角RGB数据恢复肌肉形变的方法。实验表明,该方法在不依赖传统模拟的前提下,生成符合解剖学原理的动画,具备可扩展性和低成本优势。数据与代码已公开。
原文摘要 · Abstract (English)
With the growing demand for realistic virtual humans, parametric body models have become a cornerstone of modern medicine, sports, and entertainment applications. However, most of these models are inherently limited: they only capture the 3D surface of the skin, offering no insight into the complex bio-mechanical structures that generate motion. As more applications expand towards biomechanics, the need for virtual human models that go beyond the skin has become increasingly evident. Traditional soft-tissue simulations, such as FEM, are accurate but non-scalable and too computationally expensive for most common applications. Alternatively, existing biomechanical tools can simulate muscular forces and activations, but do not model changes in external shape, restricting how activations correlate with actual observable anatomy. This motivates a novel inverse research problem: recovering muscle deformations directly from visible surface observations - i.e., from the skin, and thus the pose. In this work, we present SOMA (from Surface Observations to Muscle Anatomy), a person-specific model that infers spatio-temporal muscle behavior from surface signals obtained using RGB cameras, and SKIM, a subject-specific soft-tissue deformation dataset. To the best of our knowledge, this is the first method that attempts to recover muscle deformations from multi-view RGB data. We show how our method provides anatomically grounded animations without the complexity of traditional simulations, leading to a scalable and cost-effective solution. Data and code are available.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。