arXiv:2501.18627cs.GRcs.CV2025-01International Conf…被引 6

用5D辐射场损失直接优化表面表示,让3D重建更简单高效。

Radiance Surfaces: Optimizing Surface Representations with a 5D Radiance Field Loss

  • 改写损失函数,直接监督辐射场而非合成图像。
  • 去除了体渲染和透明混合,提升收敛到真实表面的能力。
  • 生成显式几何表面,适合需要精确形状的应用。

我们提出一种快速简单的技术,将图像转换为基于辐射表面的场景表示。在现有辐射体重建算法基础上,仅修改少量代码,通过将训练图像投影回场景中,直接监督时空方向的辐射场,从而替代沿射线积分并监督合成图像的传统方式。这一改变使体渲染和α混合完全移入损失计算环节,显著提升对表面结构的收敛能力,并赋予辐射场的二维子集明确的语义意义,使其成为可定义的辐射表面。最终从该表示中提取等值面,获得高质量的辐射表面模型。本方法保持了基线算法的速度与质量,例如,经过适当调整的Instant NGP版本在计算效率上相当,平均PSNR仅低0.1 dB。最重要的是,本方法以极简方式生成显式表面,而非指数级体积表示,优于以往工作。

原文摘要 · Abstract (English)

We present a fast and simple technique to convert images into a radiance surface-based scene representation. Building on existing radiance volume reconstruction algorithms, we introduce a subtle yet impactful modification of the loss function requiring changes to only a few lines of code: instead of integrating the radiance field along rays and supervising the resulting images, we project the training images into the scene to directly supervise the spatio-directional radiance field. The primary outcome of this change is the complete removal of alpha blending and ray marching from the image formation model, instead moving these steps into the loss computation. In addition to promoting convergence to surfaces, this formulation assigns explicit semantic meaning to 2D subsets of the radiance field, turning them into well-defined radiance surfaces. We finally extract a level set from this representation, which results in a high-quality radiance surface model. Our method retains much of the speed and quality of the baseline algorithm. For instance, a suitably modified variant of Instant NGP maintains comparable computational efficiency, while achieving an average PSNR that is only 0.1 dB lower. Most importantly, our method generates explicit surfaces in place of an exponential volume, doing so with a level of simplicity not seen in prior work.

3D重建辐射场表面表示神经渲染

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。