arXiv:2502.11971cs.CV2025-02中稿 · IEEE Transactions …被引 7

提升AR装配追踪鲁棒性,兼顾轮廓与内部特征匹配。

Robust 6DoF Pose Tracking Considering Contour and Interior Correspondence Uncertainty for AR Assembly Guidance

  • 用扇形搜索优化轮廓对应关系,建模形状与噪声不确定性
  • 通过预采样内部点+光流匹配,解决对称物体追踪难题
  • 纯CPU实现超100帧/秒,适合实时工业与医疗场景

增强现实装配指导在智能制造和医疗应用中至关重要,需持续测量操作物的6自由度姿态。尽管现有追踪方法在精度和效率上已有显著进展,但在杂乱背景、旋转对称物体和噪声序列下仍面临鲁棒性挑战。本文提出一种鲁棒的基于轮廓的姿势追踪方法,解决轮廓对应错误问题并提升抗噪能力:采用扇形搜索策略优化对应关系,将局部轮廓形状与噪声不确定性建模为混合概率分布,构建高鲁棒性的轮廓能量函数。其次,提出仅依赖CPU的策略,通过离线预采样稀疏视角模板中的内部点,并使用DIS光流算法在追踪过程中计算其对应关系,有效追踪旋转对称物体并帮助克服局部极小值。最后,构建统一的能量函数融合轮廓与内部信息,采用重加权最小二乘法求解。在公开数据集和真实场景下的实验表明,该方法显著优于现有单目追踪方法,且仅用CPU即可实现超过100 FPS的性能。

原文摘要 · Abstract (English)

Augmented reality assembly guidance is essential for intelligent manufacturing and medical applications, requiring continuous measurement of the 6DoF poses of manipulated objects. Although current tracking methods have made significant advancements in accuracy and efficiency, they still face challenges in robustness when dealing with cluttered backgrounds, rotationally symmetric objects, and noisy sequences. In this paper, we first propose a robust contour-based pose tracking method that addresses error-prone contour correspondences and improves noise tolerance. It utilizes a fan-shaped search strategy to refine correspondences and models local contour shape and noise uncertainty as mixed probability distribution, resulting in a highly robust contour energy function. Secondly, we introduce a CPU-only strategy to better track rotationally symmetric objects and assist the contour-based method in overcoming local minima by exploring sparse interior correspondences. This is achieved by pre-sampling interior points from sparse viewpoint templates offline and using the DIS optical flow algorithm to compute their correspondences during tracking. Finally, we formulate a unified energy function to fuse contour and interior information, which is solvable using a re-weighted least squares algorithm. Experiments on public datasets and real scenarios demonstrate that our method significantly outperforms state-of-the-art monocular tracking methods and can achieve more than 100 FPS using only a CPU.

AR追踪6DoF姿态轮廓匹配实时系统

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。