arXiv:2503.10464cs.CV2025-03CVPR被引 4

统一建模几何、位姿与光流,提升无先验场景重建精度

Flow-NeRF: Joint Learning of Geometry, Poses, and Dense Flow within Unified Neural Representations

  • 在神经辐射场中联合优化几何、位姿与密集光流
  • 新方法在多视角合成与深度估计上超越现有模型
  • 适合关注三维重建与视觉里程计的科研人员

在缺乏位姿先验的情况下,学习准确的场景重建在神经辐射场中面临固有的几何模糊性。现有方法要么依赖对应关系先验进行正则化,要么使用现成的光流估计器推导解析位姿。然而,将场景几何、相机位姿和密集光流联合学习于统一神经表示中的潜力尚未被充分探索。本文提出 Flow-NeRF,一个统一框架,可实时同步优化场景几何、相机位姿和密集光学流。为在神经辐射场中实现密集光流学习,我们设计并构建了基于位姿条件的双射映射。为使场景重建受益于光流估计,我们提出一种有效的特征增强机制,将规范空间特征传递至世界空间表示,显著提升场景几何质量。我们在四个重要任务上验证模型:新视角合成、深度估计、相机位姿预测和密集光流估计,使用多个数据集。该方法在几乎所有新视角合成与深度估计指标上优于先前方法,并生成定性合理且定量准确的新视角光流。项目主页:https://zhengxunzhi.github.io/flownerf/

原文摘要 · Abstract (English)

Learning accurate scene reconstruction without pose priors in neural radiance fields is challenging due to inherent geometric ambiguity. Recent development either relies on correspondence priors for regularization or uses off-the-shelf flow estimators to derive analytical poses. However, the potential for jointly learning scene geometry, camera poses, and dense flow within a unified neural representation remains largely unexplored. In this paper, we present Flow-NeRF, a unified framework that simultaneously optimizes scene geometry, camera poses, and dense optical flow all on-the-fly. To enable the learning of dense flow within the neural radiance field, we design and build a bijective mapping for flow estimation, conditioned on pose. To make the scene reconstruction benefit from the flow estimation, we develop an effective feature enhancement mechanism to pass canonical space features to world space representations, significantly enhancing scene geometry. We validate our model across four important tasks, i.e., novel view synthesis, depth estimation, camera pose prediction, and dense optical flow estimation, using several datasets. Our approach surpasses previous methods in almost all metrics for novel-view view synthesis and depth estimation and yields both qualitatively sound and quantitatively accurate novel-view flow. Our project page is https://zhengxunzhi.github.io/flownerf/.

三维重建神经辐射场光流估计位姿优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。