arXiv:2502.07140cs.CVcs.AI2025-02

仅用几张图重建多人场景的形状与外观,效果领先。

Few-Shot Multi-Human Neural Rendering Using Geometry Constraints

  • 用SMPL人体模型提供的几何约束正则化神经表示。
  • 在真实和合成数据上达到当前最优重建精度。
  • 适合需要少样本多人三维重建的研究者使用。

本文提出一种基于几何约束的少样本多人神经渲染方法,仅凭少量图像即可恢复包含多个人物的场景形状与辐射率。由于存在额外遮挡和杂乱,多人场景建模极具挑战。现有基于隐式神经表示的方法在单人场景中已取得优异成果,但难以推广至稀疏视图下的多人重建。为此,本文提出新方法:首先利用预计算的SMPL人体模型网格,通过正则化符号距离并结合包围盒提升渲染质量;其次设计射线一致性正则化与饱和度正则化,增强光照变化下的优化鲁棒性。在真实与合成数据集上的大量实验表明,该方法显著优于现有神经重建技术,实现当前最佳性能。

原文摘要 · Abstract (English)

We present a method for recovering the shape and radiance of a scene consisting of multiple people given solely a few images. Multi-human scenes are complex due to additional occlusion and clutter. For single-human settings, existing approaches using implicit neural representations have achieved impressive results that deliver accurate geometry and appearance. However, it remains challenging to extend these methods for estimating multiple humans from sparse views. We propose a neural implicit reconstruction method that addresses the inherent challenges of this task through the following contributions: First, we propose to use geometry constraints by exploiting pre-computed meshes using a human body model (SMPL). Specifically, we regularize the signed distances using the SMPL mesh and leverage bounding boxes for improved rendering. Second, we propose a ray regularization scheme to minimize rendering inconsistencies, and a saturation regularization for robust optimization in variable illumination. Extensive experiments on both real and synthetic datasets demonstrate the benefits of our approach and show state-of-the-art performance against existing neural reconstruction methods.

三维重建神经渲染少样本学习多人建模

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。