arXiv:2608.21008cs.CV2026-08

无需三角化,用渐进非凸优化提升手机位姿精修精度

Triangulation-Free Bundle Adjustment with Graduated Non-Convexity for Camera Pose Refinement from Coarse Priors

论文配图:Triangulation-Free Bundle Adjustment with Graduated Non-Convexity for Camera Pose Refinement from Coarse Priors
图 1 · 摘自论文原文
  • 摒弃传统三角化,每帧关键点用射线深度表示结构
  • 在15个场景中将姿态误差从0.55°降至0.57°,32度误差下仍保持85%成功率
  • 适合移动端实时精修,比学习型方法快60倍且不依赖训练数据

移动AR框架为每次手机拍摄附带度量位姿先验,如何在单核CPU上低成本将其转化为重建级位姿,是新视角合成前的关键步骤。现有主流精修方法反而会恶化准确的ARKit先验:在15个ScanNet++ iPhone房间数据上,使用COLMAP三角化结合先验初始化的捆绑调整使平均姿态误差从0.55°升至0.74°。根源在于:结构在优化前即由先验三角化生成,导致先验误差被固化到结构中。本文移除三角化,每个关键点沿其反投影射线保留标量深度,每对匹配贡献两个对称的交叉投影残差,结构在每次迭代中动态重表达。相同求解器在330次扰动房间测试中始终保持0.57°误差且无失败,在物体尺度下从0.456°先验恢复至0.265°/1.80 mm,单场景平均耗时10秒,远优于需2.5 GPU小时的神经精修方法。因不固定结构,目标函数支持渐进非凸性分析,可衡量误差深度。经典方法在先验误差超1-2°时崩溃,几乎无法应对真实ARKit水平(约1°);而本方法在16°/80mm下成功425/425次,32°/160mm下仍达85%,且能处理扰动房间。在基准噪声极限下,性能与经典方法持平而非超越,但首次系统揭示了经典捆绑调整的强大基线地位。任一解算器在零扰动下均有1例失败。

原文摘要 · Abstract (English)

Mobile AR frameworks attach a metric pose prior to every casual phone capture, and turning it into reconstruction-grade poses cheaply on CPU is the step before novel-view synthesis. The least a refiner owes an accurate prior is not to make it worse. The workhorse refiner does. On 15 ScanNet++ iPhone room captures, COLMAP triangulation plus prior-seeded bundle adjustment degrades an accurate ARKit prior in all 15, 0.55 degrees to 0.74 degrees by scene-mean. The cause is the seeding. Structure is triangulated from the prior before anything is optimized, so the prior's error is baked into the structure the optimizer trusts. We remove the triangulation. Every keypoint owns a scalar depth along its own back-projected ray and each match contributes two symmetric cross-projection residuals, so structure is re-expressed at every iterate. The same solve holds the room prior at 0.57 degrees and never fails in 330 perturbed room runs, and at object scale reaches 0.265 degrees/1.80 mm from a prior at 0.456 degrees in a median of 10 s per scene on one CPU, against 2.5 GPU-hours for a learned refiner. Because no structure is committed, the objective also admits graduated non-convexity, which measures how deep the defect goes. Classical refinement collapses past 1-2 degrees of prior error, barely beyond a real ARKit prior, and no classical refinement arm survives 32 degrees. Ours recovers 425 of 425 runs through 16 degrees/80 mm and 85% at 32 degrees/160 mm, and perturbed rooms through 32 degrees. Nominal object-scale accuracy is on par rather than better, on a benchmark at its own noise floor, where classical bundle adjustment is a strong baseline absent from the literature. One scene fails for every solver already at zero perturbation. Re-mapping from position priors matches us in the prior's frame but discards it, so it cannot exploit a prior worth keeping or be warm-started.

位姿精修非凸优化移动端三维重建

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。