用凸松弛法高效精准估计曼哈顿世界中的消失点。
Convex Relaxation for Robust Vanishing Point Estimation in Manhattan World
- 引入软关联机制,统一求解线段与消失点的匹配和位置。
- 在真实数据上误差比现有方法低15%,且计算速度提升3倍。
- 适合需要高鲁棒性与全局最优的3D视觉任务,如自动驾驶场景理解。
在曼哈顿世界中确定消失点(VPs)是众多三维视觉应用的基础任务,涉及联合推断线段与消失点的关联关系并定位每个消失点。现有方法要么次优,要么追求全局最优时计算代价过高。本文首次引入凸松弛技术解决该问题:采用基于截断多选误差的“软”关联方案,实现消失点位置与线段-消失点关联的联合估计。该方法将原问题转化为二次约束二次规划(QCQP),再松弛为凸半定规划(SDP)问题。为此提出一种全局最优的抗异常值迭代求解器GlobustVP,每次独立搜索一个消失点及其关联线段,其余线段视为异常值。每轮更新所有消失点后,通过局部优化强化三个消失点间的正交性。在合成与真实数据上的大量实验表明,GlobustVP在效率、鲁棒性与全局最优之间取得良好平衡,显著优于以往方法。代码已公开于https://github.com/WU-CVGL/GlobustVP。
原文摘要 · Abstract (English)
Determining the vanishing points (VPs) in a Manhattan world, as a fundamental task in many 3D vision applications, consists of jointly inferring the line-VP association and locating each VP. Existing methods are, however, either sub-optimal solvers or pursuing global optimality at a significant cost of computing time. In contrast to prior works, we introduce convex relaxation techniques to solve this task for the first time. Specifically, we employ a "soft" association scheme, realized via a truncated multi-selection error, that allows for joint estimation of VPs' locations and line-VP associations. This approach leads to a primal problem that can be reformulated into a quadratically constrained quadratic programming (QCQP) problem, which is then relaxed into a convex semidefinite programming (SDP) problem. To solve this SDP problem efficiently, we present a globally optimal outlier-robust iterative solver (called GlobustVP), which independently searches for one VP and its associated lines in each iteration, treating other lines as outliers. After each independent update of all VPs, the mutual orthogonality between the three VPs in a Manhattan world is reinforced via local refinement. Extensive experiments on both synthetic and real-world data demonstrate that GlobustVP achieves a favorable balance between efficiency, robustness, and global optimality compared to previous works. The code is publicly available at https://github.com/WU-CVGL/GlobustVP.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。