arXiv:2602.14297cs.CV2026-02

用几何描述子替代光度误差,实现高精度运动估计。

Differential pose optimization in descriptor space -- Combining Geometric and Photometric Methods for Motion Estimation

  • 用密集几何描述子构建新型误差项,融合光度与几何优势
  • 实验显示其精度未超越基于重投影误差的方法
  • 提出描述子相似性变化过慢是性能瓶颈的可能原因

计算机视觉中的核心问题之一是两帧间相对位姿优化。通常采用光度误差或重投影误差,二者分别依赖于光度特征或几何特征,各有优劣:在精度、鲁棒性和闭环可能性之间权衡。本文提出第三种方法,将两种范式优势融合为统一框架。通过密集采样的几何特征描述子,以描述子残差替代光度误差,从而在微像素级精度的差分光度方法中保留几何描述子的表达能力。实验表明,尽管该策略在跟踪精度上表现良好,但最终未能超越基于重投影误差的位姿优化方法,即使使用了更多信息。进一步分析揭示,其性能差距的根本原因可能是描述子相似性度量变化过于缓慢,且不严格对应关键点定位精度。

原文摘要 · Abstract (English)

One of the fundamental problems in computer vision is the two-frame relative pose optimization problem. Primarily, two different kinds of error values are used: photometric error and re-projection error. The selection of error value is usually directly dependent on the selection of feature paradigm, photometric features, or geometric features. It is a trade-off between accuracy, robustness, and the possibility of loop closing. We investigate a third method that combines the strengths of both paradigms into a unified approach. Using densely sampled geometric feature descriptors, we replace the photometric error with a descriptor residual from a dense set of descriptors, thereby enabling the employment of sub-pixel accuracy in differential photometric methods, along with the expressiveness of the geometric feature descriptor. Experiments show that although the proposed strategy is an interesting approach that results in accurate tracking, it ultimately does not outperform pose optimization strategies based on re-projection error despite utilizing more information. We proceed to analyze the underlying reason for this discrepancy and present the hypothesis that the descriptor similarity metric is too slowly varying and does not necessarily correspond strictly to keypoint placement accuracy.

位姿估计几何特征描述子优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。