用回归预测初解,结合在线模拟器生成匹配问题对,提升几何视觉求解效率。
Simulator HC: Regression-based Online Simulation of Starting Problem-Solution Pairs for Homotopy Continuation in Geometric Vision
- 用回归模型预测粗略初始解,由在线模拟器生成对应问题对
- 在广义相机定标和相对位姿求解中达到领先精度与成功率
- 避免复杂追踪或依赖有限训练数据,适合高维几何求解任务
尽管自动生成的多项式消元模板推动了3D计算机视觉的发展,但许多问题因约束次数或未知数过多而难以求解。近年来,同伦连续法成为一种可行替代方案。然而,该方法目前依赖于在复数域中昂贵的全部解路径并行追踪,或基于有限真实样本训练的分类网络来生成起始问题-解对。本文提出一种新方法:仅需预测一个粗略初始解,对应的起始问题由在线模拟器生成,随后通过同伦连续法将该解追踪回原问题。该方法被应用于广义相机定标,并解决了一个具有挑战性的广义相对位姿与尺度问题。实验表明,该方法有效纠正了回归器的原始误差,实现了当前最优的效率与成功率达到98.7%(在多个基准上)。
原文摘要 · Abstract (English)
While automatically generated polynomial elimination templates have sparked great progress in the field of 3D computer vision, there remain many problems for which the degree of the constraints or the number of unknowns leads to intractability. In recent years, homotopy continuation has been introduced as a plausible alternative. However, the method currently depends on expensive parallel tracking of all possible solutions in the complex domain, or a classification network for starting problem-solution pairs trained over a limited set of real-world examples. Our innovation lies in a novel approach to finding solution-problem pairs, where we only need to predict a rough initial solution, with the corresponding problem generated by an online simulator. Subsequently, homotopy continuation is applied to track that single solution back to the original problem. We apply this elegant combination to generalized camera resectioning, and also introduce a new solution to the challenging generalized relative pose and scale problem. As demonstrated, the proposed method successfully compensates the raw error committed by the regressor alone, and leads to state-of-the-art efficiency and success rates.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。