无需训练和联网,用几何过滤实现快速精准的6D物体姿态估计。
Geo6DPose: Fast Zero-Shot 6D Object Pose Estimation via Geometry-Filtered Feature Matching
- 结合视觉特征与几何投影,通过对应点匹配定位物体姿态。
- 单卡推理低于1秒,平均召回率53.7,速度达1.08帧/秒。
- 适合计算资源受限的机器人本地部署,兼容新模型且无需调参。
零样本6D物体姿态估计近期进展主要依赖大规模模型和云端推理,但这类方法常带来高延迟、高能耗及网络依赖风险,难以满足实际机器人对算力有限、需本地推理的需求。本文提出Geo6DPose,一种轻量、完全本地化、无需训练的零样本6D姿态估计方案,以几何可靠性替代模型规模。该方法将基础模型的视觉特征与几何过滤策略结合:在设备上计算模板DINO特征与场景块间的相似性图,通过将场景块中心投影至3D空间、模板特征投影至物体模型坐标系,建立双向对应关系。最终姿态通过对应驱动的RANSAC恢复,并基于重投影一致性与空间支持的加权几何对齐指标排序,提升对噪声、遮挡和部分可见性的鲁棒性。Geo6DPose在单张消费级GPU上实现亚秒级推理,达到显著更大模型基线的平均召回率(53.7 AR, 1.08 FPS),无需训练、微调或网络连接,且兼容不断演进的基础模型架构,推动机器人部署中实用的全本地6D感知发展。
原文摘要 · Abstract (English)
Recent progress in zero-shot 6D object pose estimation has been driven largely by large-scale models and cloud-based inference. However, these approaches often introduce high latency, elevated energy consumption, and deployment risks related to connectivity, cost, and data governance; factors that conflict with the practical constraints of real-world robotics, where compute is limited and on-device inference is frequently required. We introduce Geo6DPose, a lightweight, fully local, and training-free pipeline for zero-shot 6D pose estimation that trades model scale for geometric reliability. Our method combines foundation model visual features with a geometric filtering strategy: Similarity maps are computed between onboarded template DINO descriptors and scene patches, and mutual correspondences are established by projecting scene patch centers to 3D and template descriptors to the object model coordinate system. Final poses are recovered via correspondence-driven RANSAC and ranked using a weighted geometric alignment metric that jointly accounts for reprojection consistency and spatial support, improving robustness to noise, clutter, and partial visibility. Geo6DPose achieves sub-second inference on a single commodity GPU while matching the average recall of significantly larger zero-shot baselines (53.7 AR, 1.08 FPS). It requires no training, fine-tuning, or network access, and remains compatible with evolving foundation backbones, advancing practical, fully local 6D perception for robotic deployment.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。