提出可微分的辐射场不确定性量化方法,提升视觉规划与场景理解的安全性。
These Magic Moments: Differentiable Uncertainty Quantification of Radiance Field Models
- 利用渲染方程高阶矩实现辐射场输出的可微分不确定性计算
- 在合成与真实场景中均达当前最优性能,且无需后处理
- 适用于视图规划与神经辐射场训练中的主动采样
本文提出一种新型辐射场不确定性量化方法,通过利用渲染方程的高阶矩实现高效且可微分的计算。不确定性量化对视图规划与场景理解等下游任务至关重要,但辐射场的高维复杂性使其难以应用。我们证明渲染过程的概率特性支持对颜色、深度和语义预测的高阶矩进行可微分计算。所提方法在性能上超越现有技术,提供更直接、高效且无需后处理的公式。此外,该方法在下一最佳视图选择与神经辐射场训练中的主动射线采样中也展现出实用性。在合成与真实场景上的大量实验验证了其有效性,达到业界领先表现的同时保持简洁性。
原文摘要 · Abstract (English)
This paper introduces a novel approach to uncertainty quantification for radiance fields by leveraging higher-order moments of the rendering equation. Uncertainty quantification is crucial for downstream tasks including view planning and scene understanding, where safety and robustness are paramount. However, the high dimensionality and complexity of radiance fields pose significant challenges for uncertainty quantification, limiting the use of these uncertainty quantification methods in high-speed decision-making. We demonstrate that the probabilistic nature of the rendering process enables efficient and differentiable computation of higher-order moments for radiance field outputs, including color, depth, and semantic predictions. Our method outperforms existing radiance field uncertainty estimation techniques while offering a more direct, computationally efficient, and differentiable formulation without the need for post-processing. Beyond uncertainty quantification, we also illustrate the utility of our approach in downstream applications such as next-best-view (NBV) selection and active ray sampling for neural radiance field training. Extensive experiments on synthetic and real-world scenes confirm the efficacy of our approach, which achieves state-of-the-art performance while maintaining simplicity.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。