arXiv:2506.17119cs.CVcs.RO2025-06中稿 · IROS 2025被引 4

仅用彩色图像实现快速稳定的6自由度位姿估计与跟踪

RGBTrack: Fast, Robust Depth-Free 6D Pose Estimation and Tracking

  • 基于二分搜索与渲染对比策略,从真实尺度的CAD模型推断深度
  • 在动态场景下保持稳定跟踪,支持快速运动和遮挡恢复
  • 可自适应未知尺度的模型,适合机器人与增强现实应用

我们提出RGBTrack框架,实现仅依赖彩色图像的实时6自由度位姿估计与跟踪,无需深度输入即可完成高动态、高精度的目标位姿追踪。基于FoundationPose架构,设计新型二分搜索策略结合渲染对比机制,从真实尺度的CAD模型高效推断深度并生成鲁棒位姿假设。为应对快速运动与遮挡等动态挑战,集成先进2D跟踪器XMem、卡尔曼滤波器与状态机,实现主动位姿恢复。此外,尺度恢复模块通过初始深度估计动态适配未知尺度的CAD模型,支持与现代生成式重建技术无缝融合。在多个基准数据集上的大量实验表明,该无深度方法在精度与实时性上均具竞争力,是机器人、增强现实与计算机视觉领域极具潜力的实际解决方案。代码将公开于https://github.com/GreatenAnoymous/RGBTrack.git。

原文摘要 · Abstract (English)

We introduce a robust framework, RGBTrack, for real-time 6D pose estimation and tracking that operates solely on RGB data, thereby eliminating the need for depth input for such dynamic and precise object pose tracking tasks. Building on the FoundationPose architecture, we devise a novel binary search strategy combined with a render-and-compare mechanism to efficiently infer depth and generate robust pose hypotheses from true-scale CAD models. To maintain stable tracking in dynamic scenarios, including rapid movements and occlusions, RGBTrack integrates state-of-the-art 2D object tracking (XMem) with a Kalman filter and a state machine for proactive object pose recovery. In addition, RGBTrack's scale recovery module dynamically adapts CAD models of unknown scale using an initial depth estimate, enabling seamless integration with modern generative reconstruction techniques. Extensive evaluations on benchmark datasets demonstrate that RGBTrack's novel depth-free approach achieves competitive accuracy and real-time performance, making it a promising practical solution candidate for application areas including robotics, augmented reality, and computer vision. The source code for our implementation will be made publicly available at https://github.com/GreatenAnoymous/RGBTrack.git.

位姿估计彩色图像实时跟踪6D姿态

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。