arXiv:2506.08619cs.CV2025-06ECCV被引 3

用概率引导采样,让3D渲染更聚焦重点区域。

A Probability-guided Sampler for Neural Implicit Surface Rendering

  • 基于3D投影空间建模概率密度,智能聚焦重要区域采样。
  • 新损失函数融合近表面与空域信息,提升重建精度。
  • 适合需要高细节3D重建的场景,尤其对关键区域优化显著。

神经辐射场(NeRF)系列方法显著提升了图像合成与3D场景/物体表面重建的精度。然而,由于可扩展性限制,这些方法无法对所有可能的输入数据(如每像素及射线上的每个3D点)进行训练。尽管原始NeRF均匀采样像素和射线上的3D点,部分变体仅关注优化射线上的3D点采样。本文利用前景场景的隐式表面表示,在3D图像投影空间中建模概率密度函数,实现对感兴趣区域的更精准采样,从而提升渲染效果。此外,提出一种新的表面重建损失,充分挖掘所提出的3D图像投影空间模型,整合近表面与空域成分。将该采样策略与损失函数集成至当前最先进的神经隐式表面渲染器中,显著提升了3D重建的准确性和细节表现,尤其在任意场景的关键区域效果更优。

原文摘要 · Abstract (English)

Several variants of Neural Radiance Fields (NeRFs) have significantly improved the accuracy of synthesized images and surface reconstruction of 3D scenes/objects. In all of these methods, a key characteristic is that none can train the neural network with every possible input data, specifically, every pixel and potential 3D point along the projection rays due to scalability issues. While vanilla NeRFs uniformly sample both the image pixels and 3D points along the projection rays, some variants focus only on guiding the sampling of the 3D points along the projection rays. In this paper, we leverage the implicit surface representation of the foreground scene and model a probability density function in a 3D image projection space to achieve a more targeted sampling of the rays toward regions of interest, resulting in improved rendering. Additionally, a new surface reconstruction loss is proposed for improved performance. This new loss fully explores the proposed 3D image projection space model and incorporates near-to-surface and empty space components. By integrating our novel sampling strategy and novel loss into current state-of-the-art neural implicit surface renderers, we achieve more accurate and detailed 3D reconstructions and improved image rendering, especially for the regions of interest in any given scene.

3D重建神经渲染隐式表面采样优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。