arXiv:2609.05972cs.CV2026-09

不依赖相机参数,用多帧点匹配实现稳定3D结构重建。

Efficient and Robust Camera-independent Multiview 3D Geometric Reconstruction from Noisy Monocular Depth Estimation and Multiple Point Matching

  • 通过多帧点对应关系学习不变的线性自回归矩阵,刻画点间几何关系。
  • 在单目深度图噪声下仍能稳健估计3D结构,无需恢复相机位姿。
  • 适用于弱透视场景,适合移动设备或无标定相机的实时重建任务。

我们提出一种高效且鲁棒的3D几何重建方法,仅依赖于点集间的相机无关线性关系。这些关系在时间上稳定,可通过多帧点匹配可靠估计。方法从多帧点对应中学习一个线性几何自回归矩阵 $oldsymbol{W}$,该矩阵将任一3D点表示为其他点的线性组合,其为点集的内在属性,与世界坐标系和相机姿态无关。$oldsymbol{W}$ 的主特征向量(特征值均为1)提供点配置的齐次表示。第一版本利用噪声较大的单目深度图,结合多帧信息,稳健构建 $oldsymbol{W}$,借助当前快速但嘈杂的深度估计模型。第二版本无需深度图,适用于弱透视投影情形,可从2D图像投影中可靠估计3D点间的线性关系。整个推导过程不涉及相机投影矩阵,因此不恢复相机位姿,仅重建3D结构,这与传统重建方法有本质区别。

原文摘要 · Abstract (English)

We present an efficient and robust method for 3D geometric reconstruction that is based solely on the camera-independent linear relationships among a given set of points, which are stable over time and robustly estimated using multiple point matches. We essentially learn, from correspondences between points across several frames, a linear geometric auto-regression matrix $\mathbf{W}$, which establishes how a point in 3D can be expressed as a linear combination of all the others. This matrix is constant and does not depend on the world coordinate system or the camera pose---it is an intrinsic property of the point set. We also show that the principal eigenvectors of $\mathbf{W}$, which all have eigenvalue $1$, provide a homogeneous representation of the 3D point configuration. The first version of our method takes advantage of noisy monocular depth maps in order to obtain, from multiple frames, a robust geometric auto-regression matrix $\mathbf{W}$ of linear relationships between the 3D points. Thus, we build on recent advances in deep learning, which now provide monocular depth estimation models that are fast but very often noisy. Our approach handles noise through robust linear estimation over several frames. The second version of our method does not need monocular depth estimation maps. It applies in cases of weak-perspective projection, when the linear combinations between the 3D points can be robustly estimated from their 2D projections in the image. Note that the camera projection matrix is never used in our derivations. Consequently, our method does not recover camera pose, but only 3D structure. This is a key difference between our method and the related literature on 3D geometric reconstruction.

3D重建几何建模单目深度鲁棒估计

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。