构建动态物体位姿估计新基准,支持移动相机场景下的精准标注。
DynOPETs: A Versatile Benchmark for Dynamic Object Pose Estimation and Tracking in Moving Camera Scenarios
- 用姿态估计与跟踪结合生成伪标签,再通过图优化精修。
- 18种先进方法验证,数据集可显著推动该领域研究。
- 专为移动相机中动态物体设计,适合做位姿估计的算法测试。
在物体位姿估计领域,动态物体与移动相机共存的场景十分常见,但真实世界数据集匮乏,严重制约了鲁棒模型的发展与评估。这主要源于在运动相机拍摄的动态场景中准确标注物体位姿的难度。为此,本文提出新数据集 DynOPETs 及专门的数据采集与标注流程,适用于此类非受限环境中的位姿估计与跟踪任务。提出的高效标注方法创新性地融合姿态估计与跟踪技术生成伪标签,并通过姿态图优化进行精细化修正,最终获得高精度的位姿标注。为验证数据集的有效性,我们使用18种前沿方法进行了全面评估,证明其在推动该挑战性领域的研究方面具有重要价值。数据集将公开发布,以促进后续研究进展。
原文摘要 · Abstract (English)
In the realm of object pose estimation, scenarios involving both dynamic objects and moving cameras are prevalent. However, the scarcity of corresponding real-world datasets significantly hinders the development and evaluation of robust pose estimation models. This is largely attributed to the inherent challenges in accurately annotating object poses in dynamic scenes captured by moving cameras. To bridge this gap, this paper presents a novel dataset DynOPETs and a dedicated data acquisition and annotation pipeline tailored for object pose estimation and tracking in such unconstrained environments. Our efficient annotation method innovatively integrates pose estimation and pose tracking techniques to generate pseudo-labels, which are subsequently refined through pose graph optimization. The resulting dataset offers accurate pose annotations for dynamic objects observed from moving cameras. To validate the effectiveness and value of our dataset, we perform comprehensive evaluations using 18 state-of-the-art methods, demonstrating its potential to accelerate research in this challenging domain. The dataset will be made publicly available to facilitate further exploration and advancement in the field.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。