arXiv:2509.18979cs.ROcs.CV2025-09中稿 · ICRA被引 2

毫秒级估算物体形状与位姿,仅需类别先验信息。

Category-Level Object Shape and Pose Estimation in Less Than a Millisecond

  • 用学习的前端检测类别级语义关键点,结合线性主动形状模型建模未知形状。
  • 每轮迭代仅需100微秒,整体求解在0.5毫秒内完成,支持全局最优性验证。
  • 适用于机器人抓取、无人机跟踪等实时场景,代码已开源。

物体形状与位姿估计是机器人领域的基础问题,支撑操作、场景理解与导航等任务。本文提出一种快速局部求解器,仅需类别级物体先验信息,并能高效验证全局最优性。给定一张RGB-D图像,我们使用学习的前段模块检测目标物体上的稀疏类别级语义关键点。通过线性主动形状模型表示目标物体的未知形状,并将位置、姿态和形状联合估计建模为最大后验概率优化问题。该问题以单位四元数表示,其一阶最优性条件可化为带有非线性特征向量的特征值问题。我们的核心贡献是采用自洽场迭代法高效求解,每轮仅需计算一个4×4矩阵并求其最小特征值-特征向量对。通过求解对应的拉格朗日乘子线性系统,可获得简单有效的全局最优性证书。单次迭代耗时约100微秒,支持快速异常值剔除。我们在合成数据及多种真实场景中测试了方法,包括两个公开数据集和无人机跟踪任务。代码已发布于https://github.com/MIT-SPARK/Fast-ShapeAndPose。

原文摘要 · Abstract (English)

Object shape and pose estimation is a foundational robotics problem, supporting tasks from manipulation to scene understanding and navigation. We present a fast local solver for shape and pose estimation which requires only category-level object priors and admits an efficient certificate of global optimality. Given an RGB-D image of an object, we use a learned front-end to detect sparse, category-level semantic keypoints on the target object. We represent the target object's unknown shape using a linear active shape model and pose a maximum a posteriori optimization problem to solve for position, orientation, and shape simultaneously. Expressed in unit quaternions, this problem admits first-order optimality conditions in the form of an eigenvalue problem with eigenvector nonlinearities. Our primary contribution is to solve this problem efficiently with self-consistent field iteration, which only requires computing a 4-by-4 matrix and finding its minimum eigenvalue-vector pair at each iterate. Solving a linear system for the corresponding Lagrange multipliers gives a simple global optimality certificate. One iteration of our solver runs in about 100 microseconds, enabling fast outlier rejection. We test our method on synthetic data and a variety of real-world settings, including two public datasets and a drone tracking scenario. Code is released at https://github.com/MIT-SPARK/Fast-ShapeAndPose.

位姿估计形状建模实时推理机器人感知

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。