仅用一张彩色图,一步完成多物体9维位姿估计,性能超越现有纯视觉方法。
You Only Pose Once: A Minimalist's Detection Transformer for Monocular RGB Category-level 9D Multi-Object Pose Estimation
- 单阶段查询式框架,将2D检测与9维位姿估计统一建模。
- 在REAL275上达到79.6% IoU50和54.1% 10°10cm精度,逼近RGB-D系统。
- 无需深度图或3D模型,适合机器人抓取等实时应用场景。
从单张彩色图像中准确恢复特定类别未见实例的完整9自由度位姿,仍是机器人与自动化领域的核心挑战。现有方法大多依赖伪深度、CAD模型或分阶段级联结构,将2D检测与位姿估计分离。为寻求更简洁的纯彩色图像方案,并直接在类别层面学习,我们重新思考一个长期问题:能否在不额外数据的前提下,以高性能统一对象检测与9维位姿估计?我们提出YOPO——一种单阶段、基于查询的框架,将类别级9维位姿估计视为2D检测的自然延伸。YOPO在Transformer检测器基础上添加轻量级位姿头、边界框条件平移模块及6维感知匈牙利匹配代价。模型仅使用彩色图像和类别级位姿标签端到端训练。尽管设计极简,YOPO在三个基准上均创历史新高。在REAL275数据集上,达到79.6% IoU50与54.1% 10°10cm指标,显著超越现有纯视觉方法,并大幅缩小与RGB-D系统的差距。代码、模型与更多可视化结果见https://mikigom.github.io/YOPO-project-page。
原文摘要 · Abstract (English)
Accurately recovering the full 9-DoF pose of unseen instances within specific categories from a single RGB image remains a core challenge for robotics and automation. Most existing solutions still rely on pseudo-depth, CAD models, or multi-stage cascades that separate 2D detection from pose estimation. Motivated by the need for a simpler, RGB-only alternative that learns directly at the category level, we revisit a longstanding question: Can object detection and 9-DoF pose estimation be unified with high performance, without any additional data? We show that they can with our method, YOPO, a single-stage, query-based framework that treats category-level 9-DoF estimation as a natural extension of 2D detection. YOPO augments a transformer detector with a lightweight pose head, a bounding-box-conditioned translation module, and a 6D-aware Hungarian matching cost. The model is trained end-to-end only with RGB images and category-level pose labels. Despite its minimalist design, YOPO sets a new state of the art on three benchmarks. On the REAL275 dataset, it achieves 79.6% $\rm{IoU}_{50}$ and 54.1% under the $10^\circ$$10{\rm{cm}}$ metric, surpassing prior RGB-only methods and closing much of the gap to RGB-D systems. The code, models, and additional qualitative results can be found on https://mikigom.github.io/YOPO-project-page.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。