arXiv:2504.10433cs.CVcs.RO2025-04ICRA被引 7

用扩散模型实现无需先验的单目9D物体位姿估计,提升机器人感知能力。

MonoDiff9D: Monocular Category-Level 9D Object Pose Estimation via Diffusion Model

论文配图:MonoDiff9D: Monocular Category-Level 9D Object Pose Estimation via Diffusion Model
图 1 · 摘自论文原文
  • 基于扩散模型生成物体位姿,不依赖形状先验或CAD模型
  • 在两个基准数据集上达到当前最佳精度,零样本估计深度并生成点云
  • 适合无模型先验的未知类别物体位姿估计场景

物体位姿估计是机器人理解与交互环境的核心技术。单目类别级方法因仅需单个RGB相机而具有吸引力,但现有方法依赖同类已知物体的形状先验或CAD模型。本文提出基于扩散模型的单目类别级9D物体位姿生成方法MonoDiff9D,旨在利用扩散模型的概率特性,避免对形状先验、CAD模型或深度传感器的需求。首先通过DINOv2零样本估计粗略深度,并转换为点云;随后融合点云全局特征与输入图像,结合编码的时间步条件输入模型;最后设计基于Transformer的去噪器从高斯噪声中恢复物体位姿。在两个主流基准数据集上的大量实验表明,MonoDiff9D在无需任何阶段使用形状先验或CAD模型的前提下,实现了当前最优的单目类别级9D物体位姿估计精度。代码将公开于https://github.com/CNJianLiu/MonoDiff9D。

原文摘要 · Abstract (English)

Object pose estimation is a core means for robots to understand and interact with their environment. For this task, monocular category-level methods are attractive as they require only a single RGB camera. However, current methods rely on shape priors or CAD models of the intra-class known objects. We propose a diffusion-based monocular category-level 9D object pose generation method, MonoDiff9D. Our motivation is to leverage the probabilistic nature of diffusion models to alleviate the need for shape priors, CAD models, or depth sensors for intra-class unknown object pose estimation. We first estimate coarse depth via DINOv2 from the monocular image in a zero-shot manner and convert it into a point cloud. We then fuse the global features of the point cloud with the input image and use the fused features along with the encoded time step to condition MonoDiff9D. Finally, we design a transformer-based denoiser to recover the object pose from Gaussian noise. Extensive experiments on two popular benchmark datasets show that MonoDiff9D achieves state-of-the-art monocular category-level 9D object pose estimation accuracy without the need for shape priors or CAD models at any stage. Our code will be made public at https://github.com/CNJianLiu/MonoDiff9D.

位姿估计扩散模型单目视觉机器人感知

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。