arXiv:2504.20607cs.CV2025-04被引 2

用2D高斯表示人体动作,实现分钟级高质量动态重建

EfficientHuman: Efficient Training and Reconstruction of Moving Human using Articulated 2D Gaussian

  • 将高斯点转为带骨骼绑定的2D表面元,实现快速姿态变换
  • 在ZJU-MoCap上1分钟内完成重建,比现有方法快20秒
  • 适合需要快速人体3D重建的实时应用开发者

3D高斯溅射(3DGS)已成为场景重建与新视角合成的前沿技术。近期基于3DGS的人体三维重建尝试利用人体姿态先验提升渲染质量并加快训练速度,但仍因多视角不一致和冗余高斯点难以有效拟合动态表面。这种不一致源于高斯椭球无法准确表示动态物体表面,阻碍了人体的快速重建;而冗余高斯点也导致训练时间仍不理想。为此,我们提出EfficientHuman,一种使用关节式2D高斯表面元实现高效人体动态重建的模型,同时保证高质量渲染。核心创新在于:将高斯点编码为规范空间中的关节式2D高斯表面元,并通过线性骨骼混合(LBS)映射到姿态空间,实现高效的姿态变换。相比3D高斯,关节式2D高斯表面元能快速贴合动态人体,确保视角一致性。此外,引入姿态校准模块与LBS优化模块,实现对动态人体姿态的精准拟合,提升模型性能。在ZJU-MoCap数据集上的大量实验表明,EfficientHuman平均可在一分钟内完成3D动态人体重建,比当前最先进方法快20秒,同时显著减少冗余高斯点数量。

原文摘要 · Abstract (English)

3D Gaussian Splatting (3DGS) has been recognized as a pioneering technique in scene reconstruction and novel view synthesis. Recent work on reconstructing the 3D human body using 3DGS attempts to leverage prior information on human pose to enhance rendering quality and improve training speed. However, it struggles to effectively fit dynamic surface planes due to multi-view inconsistency and redundant Gaussians. This inconsistency arises because Gaussian ellipsoids cannot accurately represent the surfaces of dynamic objects, which hinders the rapid reconstruction of the dynamic human body. Meanwhile, the prevalence of redundant Gaussians means that the training time of these works is still not ideal for quickly fitting a dynamic human body. To address these, we propose EfficientHuman, a model that quickly accomplishes the dynamic reconstruction of the human body using Articulated 2D Gaussian while ensuring high rendering quality. The key innovation involves encoding Gaussian splats as Articulated 2D Gaussian surfels in canonical space and then transforming them to pose space via Linear Blend Skinning (LBS) to achieve efficient pose transformations. Unlike 3D Gaussians, Articulated 2D Gaussian surfels can quickly conform to the dynamic human body while ensuring view-consistent geometries. Additionally, we introduce a pose calibration module and an LBS optimization module to achieve precise fitting of dynamic human poses, enhancing the model's performance. Extensive experiments on the ZJU-MoCap dataset demonstrate that EfficientHuman achieves rapid 3D dynamic human reconstruction in less than a minute on average, which is 20 seconds faster than the current state-of-the-art method, while also reducing the number of redundant Gaussians.

3D重建高斯溅射人体动作实时重建

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。