arXiv:2506.23236cs.CVcs.AI2025-06ICCV被引 9

用神经体积模型高效建模人体交互与碰撞,速度快10倍,显存降6倍。

VolumetricSMPL: A Neural Volumetric Body Model for Efficient Interactions, Contacts, and Collisions

  • 通过动态混合权重矩阵,用小MLP实现高效率人体建模
  • 推理速度比COAP快10倍,显存使用降低6倍
  • 适合需要快速物理交互的虚拟人、动画与场景重建任务

参数化人体模型在计算机图形学与视觉中至关重要,广泛应用于运动分析与人-环境交互理解。传统基于表面网格的模型难以高效处理与物体或场景(以网格或点云表示)的交互。近期研究尝试采用体积神经隐式模型,但现有方法在复杂人体姿态下鲁棒性不足,或计算与内存开销过高。为此,我们提出VolumetricSMPL,一种基于神经混合权重(NBW)的神经体积人体模型。NBW通过预测的形状与姿态相关系数,动态融合一组小型学习权重矩阵,生成紧凑高效的MLP解码器。相比依赖大型MLP的先前方法,该设计显著提升计算效率并保持表达能力。VolumetricSMPL在推理速度上比前序体积占用模型COAP快10倍,GPU内存使用降低6倍,精度更高,并支持可微分的有符号距离函数(SDF),便于接触建模。我们在四项挑战任务中验证其性能:(1)从真实图像重建人-物交互,(2)从第一视角恢复3D场景中的人体网格,(3)场景约束下的运动合成,(4)自交问题消解。结果表明其具备广泛应用潜力与显著的性能与效率优势。

原文摘要 · Abstract (English)

Parametric human body models play a crucial role in computer graphics and vision, enabling applications ranging from human motion analysis to understanding human-environment interactions. Traditionally, these models use surface meshes, which pose challenges in efficiently handling interactions with other geometric entities, such as objects and scenes, typically represented as meshes or point clouds. To address this limitation, recent research has explored volumetric neural implicit body models. However, existing works are either insufficiently robust for complex human articulations or impose high computational and memory costs, limiting their widespread use. To this end, we introduce VolumetricSMPL, a neural volumetric body model that leverages Neural Blend Weights (NBW) to generate compact, yet efficient MLP decoders. Unlike prior approaches that rely on large MLPs, NBW dynamically blends a small set of learned weight matrices using predicted shape- and pose-dependent coefficients, significantly improving computational efficiency while preserving expressiveness. VolumetricSMPL outperforms prior volumetric occupancy model COAP with 10x faster inference, 6x lower GPU memory usage, enhanced accuracy, and a Signed Distance Function (SDF) for efficient and differentiable contact modeling. We demonstrate VolumetricSMPL's strengths across four challenging tasks: (1) reconstructing human-object interactions from in-the-wild images, (2) recovering human meshes in 3D scenes from egocentric views, (3) scene-constrained motion synthesis, and (4) resolving self-intersections. Our results highlight its broad applicability and significant performance and efficiency gains.

人体建模神经隐式体积表示物理交互

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。