arXiv:2502.02338cs.CVcs.LG2025-02

用几何基函数建模不确定性,让神经场更懂新场景

Geometric Neural Process Fields

  • 用几何基函数捕捉空间结构,提升神经场泛化能力
  • 在少样本下实现3D视角合成与2D/1D信号回归的高精度预测
  • 适合需要鲁棒性与不确定性估计的3D重建和生成任务

本文针对神经场(NeF)泛化难题,提出几何神经过程场(G-NPF),一种显式建模不确定性的概率框架。将NeF泛化问题转化为概率推断,从少量上下文观测中直接推导神经场函数分布。引入一组几何基函数以编码空间结构,辅助函数分布推断。在此基础上设计分层潜在变量模型,实现多尺度结构信息融合,有效参数化INR函数。实验表明,该方法在3D新视角合成、2D图像及1D信号回归任务中均能有效捕捉不确定性,并显著提升对新场景和未见信号的泛化性能。

原文摘要 · Abstract (English)

This paper addresses the challenge of Neural Field (NeF) generalization, where models must efficiently adapt to new signals given only a few observations. To tackle this, we propose Geometric Neural Process Fields (G-NPF), a probabilistic framework for neural radiance fields that explicitly captures uncertainty. We formulate NeF generalization as a probabilistic problem, enabling direct inference of NeF function distributions from limited context observations. To incorporate structural inductive biases, we introduce a set of geometric bases that encode spatial structure and facilitate the inference of NeF function distributions. Building on these bases, we design a hierarchical latent variable model, allowing G-NPF to integrate structural information across multiple spatial levels and effectively parameterize INR functions. This hierarchical approach improves generalization to novel scenes and unseen signals. Experiments on novel-view synthesis for 3D scenes, as well as 2D image and 1D signal regression, demonstrate the effectiveness of our method in capturing uncertainty and leveraging structural information for improved generalization.

神经场不确定性3D生成几何先验

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。