arXiv:2603.20428cs.CV2026-03被引 1

对比高效与精准的相机位姿估计方法,助力新视角合成

Benchmarking Efficient & Effective Camera Pose Estimation Strategies for Novel View Synthesis

  • 用更少特征点加速传统SfM,保持高精度
  • 先用神经网络粗估再用传统SfM优化,效率效果最佳
  • 为新视角合成提供可复现的基准测试

新视角合成(NVS)方法如NeRF或3DGS可从已知内外参的图像集生成逼真三维场景表示。相机位姿与标定通常通过结构光流(SfM)从图像中获取。经典SfM依赖图像间的局部特征匹配,估计位姿与稀疏三维场景,并通过捆绑调整优化初始估计。为提升运行效率,近期SfM系统放弃捆绑调整,转而训练前馈式(基于Transformer)神经网络直接回归相机参数与三维结构。虽效率提升数个数量级,但精度显著下降。为推动兼具高效与精准的SfM研究,本文构建针对新视角合成的基准测试。基于现有数据集及两种简化重建流程策略,我们发现:(1) 仅使用更少特征点即可显著加速经典SfM,同时维持高姿态精度;(2) 利用前馈网络获得初始估计并结合经典SfM技术进行精修,可实现最优的效率-效果权衡。相关基准与代码将公开。

原文摘要 · Abstract (English)

Novel view synthesis (NVS) approaches such as NeRFs or 3DGS can produce photo-realistic 3D scene representation from a set of images with known extrinsic and intrinsic parameters. The necessary camera poses and calibrations are typically obtained from the images via Structure-from-Motion (SfM). Classical SfM approaches rely on local feature matches between the images to estimate both the poses and a sparse 3D model of the scene, using bundle adjustment to refine initial pose, intrinsics, and geometry estimates. In order to increase run-time efficiency, recent SfM systems forgo optimization via bundle adjustment. Instead, they train feed-forward (transformer-based) neural networks to directly regress camera parameters and the 3D structure. While orders of magnitude more efficient, such recent works produce significantly less accurate estimates. To stimulate research on developing SfM approaches that are both efficient \emph{and} effective, this paper develops a benchmark focused on SfM for novel view synthesis. Using existing datasets and two simple strategies for making the reconstruction process more efficient, we show that: (1) simply using fewer features already significantly accelerates classical SfM methods while maintaining high pose accuracy. (2) using feed-forward networks to obtain initial estimates and refining them using classical SfM techniques leads to the best efficiency-effectiveness trade-off. We will make our benchmark and code publicly available.

三维重建相机位姿新视角合成SfM

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。