arXiv:2509.21927cs.CV2025-09NeurIPS被引 2

仅用一张彩色图就能准确定位物体6D姿态,适合光照差或反光场景。

SingRef6D: Monocular Novel Object Pose Estimation with a Single RGB Reference

  • 用单张彩色图结合深度增强机制,提升复杂表面的深度预测精度。
  • 在真实数据集上姿态估计平均召回率提升6.1%,优于当前最佳方法。
  • 无需深度传感器或多视角图像,适合资源受限设备部署。

现有6D姿态估计算法虽表现优异,但常依赖深度传感器,在透明或高反光表面等条件下失效。而纯RGB方法在低光照、无纹理场景中因缺乏几何信息,匹配性能较差。为此,我们提出SingRef6D,仅需一张RGB参考图即可完成姿态估计,无需昂贵深度传感器、多视角图像或视图合成模型训练,适用于深度信息缺失或资源受限的场景。框架包含两项创新:一是基于token-scaler的微调机制,结合深度-任意(Depth-Anything v2)模型并引入新优化损失,使深度预测在真实数据集REAL275上δ_{1.05}指标提升14.41%;二是利用深度信息设计感知深度的匹配流程,有效融合空间关系至LoFTR,显著提升对挑战性材质与光照条件下的匹配能力。在REAL275、ClearPose和Toyota-Light三个数据集上的姿态估计评估显示,本方法平均召回率提升6.1%,超越现有最先进方法。

原文摘要 · Abstract (English)

Recent 6D pose estimation methods demonstrate notable performance but still face some practical limitations. For instance, many of them rely heavily on sensor depth, which may fail with challenging surface conditions, such as transparent or highly reflective materials. In the meantime, RGB-based solutions provide less robust matching performance in low-light and texture-less scenes due to the lack of geometry information. Motivated by these, we propose SingRef6D, a lightweight pipeline requiring only a single RGB image as a reference, eliminating the need for costly depth sensors, multi-view image acquisition, or training view synthesis models and neural fields. This enables SingRef6D to remain robust and capable even under resource-limited settings where depth or dense templates are unavailable. Our framework incorporates two key innovations. First, we propose a token-scaler-based fine-tuning mechanism with a novel optimization loss on top of Depth-Anything v2 to enhance its ability to predict accurate depth, even for challenging surfaces. Our results show a 14.41% improvement (in $δ_{1.05}$) on REAL275 depth prediction compared to Depth-Anything v2 (with fine-tuned head). Second, benefiting from depth availability, we introduce a depth-aware matching process that effectively integrates spatial relationships within LoFTR, enabling our system to handle matching for challenging materials and lighting conditions. Evaluations of pose estimation on the REAL275, ClearPose, and Toyota-Light datasets show that our approach surpasses state-of-the-art methods, achieving a 6.1% improvement in average recall.

6D姿态估计单目视觉深度预测弱纹理

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。