提出显式几何方法解决神经辐射场在密集遮挡场景中的内部结构失真问题。
From Implicit Ambiguity to Explicit Solidity: Diagnosing Interior Geometric Degradation in Neural Radiance Fields for Dense 3D Scene Understanding
- 用显式体素栅格替代隐式密度场,通过递归分割保持物体物理实体性。
- 在密集遮挡场景中实现95.8%实例恢复率,远超隐式方法的89%上限。
- 适合需要精确三维量化分析的复杂遮挡场景,如工业检测与机器人导航。
神经辐射场(NeRF)已成为多视角重建的强大范式,但其在密集自遮挡场景中进行定量3D分析的可靠性仍不明确。本文揭示了隐式密度场在强遮挡下的根本缺陷——内部几何退化(IGD),发现基于透射率的体积优化会重构空心或碎片化结构而非实心内部,导致实例系统性漏检。在合成数据集上,随着遮挡程度增加,最先进的掩码监督NeRF在密集场景中实例恢复率饱和于约89%,尽管表面连贯性和掩码质量已提升。为此,本文提出基于稀疏体素光栅化(SVRaster)的显式几何流程,以SfM特征几何初始化。通过将2D实例掩码投影至显式体素网格并递归分割强制几何分离,该方法保留物理实体性,在密集簇中实现95.8%的恢复率。对退化分割掩码的敏感性分析显示,显式SfM几何对监督失效更具鲁棒性,比隐式基线多恢复43%实例。结果表明,显式几何先验是高自遮挡3D场景可靠定量分析的前提。
原文摘要 · Abstract (English)
Neural Radiance Fields (NeRFs) have emerged as a powerful paradigm for multi-view reconstruction, complementing classical photogrammetric pipelines based on Structure-from-Motion (SfM) and Multi-View Stereo (MVS). However, their reliability for quantitative 3D analysis in dense, self-occluding scenes remains poorly understood. In this study, we identify a fundamental failure mode of implicit density fields under heavy occlusion, which we term Interior Geometric Degradation (IGD). We show that transmittance-based volumetric optimization satisfies photometric supervision by reconstructing hollow or fragmented structures rather than solid interiors, leading to systematic instance undercounting. Through controlled experiments on synthetic datasets with increasing occlusion, we demonstrate that state-of-the-art mask-supervised NeRFs saturate at approximately 89% instance recovery in dense scenes, despite improved surface coherence and mask quality. To overcome this limitation, we introduce an explicit geometric pipeline based on Sparse Voxel Rasterization (SVRaster), initialized from SfM feature geometry. By projecting 2D instance masks onto an explicit voxel grid and enforcing geometric separation via recursive splitting, our approach preserves physical solidity and achieves a 95.8% recovery rate in dense clusters. A sensitivity analysis using degraded segmentation masks further shows that explicit SfM-based geometry is substantially more robust to supervision failure, recovering 43% more instances than implicit baselines. These results demonstrate that explicit geometric priors are a prerequisite for reliable quantitative analysis in highly self-occluding 3D scenes.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。