arXiv:2502.20606cs.ROcs.LG2025-02被引 8

机器人通过预测物体位置与状态,智能规划抓取动作以清理遮挡物。

Map Space Belief Prediction for Manipulation-Enhanced Mapping

  • 用网格地图表示信念,神经网络实时更新物体位置、形状、类别和遮挡关系。
  • 在仿真中提升地图完整度与准确率,零样本迁移至真实杂乱货架成功。
  • 可校准不确定性估计,适合复杂场景下的自主感知与操作任务。

在杂乱环境中搜索物体需要高效选择视角和操作动作以消除遮挡并降低对物体位置、形状和类别的不确定性。本文研究操纵增强的语义地图构建问题,目标是让机器人高效识别杂乱货架中的所有物体。尽管部分可观测马尔可夫决策过程(POMDP)是不确定环境下决策的标准方法,但在处理非结构化交互环境时仍具挑战。为此,我们定义了一个以度量-语义网格地图为信念表示的POMDP,提出一种新型框架,利用神经网络实现地图空间中的信念更新,从而高效同步推理物体几何、位置、类别、遮挡及操作物理特性。为进一步实现精确的信息增益分析,所学信念更新需保持不确定性估计的校准性。因此,我们提出校准型神经加速信念更新(CNABUs),学习一个能泛化到新场景且对未知区域提供可信度校准预测的信念传播模型。实验表明,该新型POMDP规划器在复杂仿真中显著提升地图完整性和准确性,并成功实现零样本迁移至真实杂乱货架。

原文摘要 · Abstract (English)

Searching for objects in cluttered environments requires selecting efficient viewpoints and manipulation actions to remove occlusions and reduce uncertainty in object locations, shapes, and categories. In this work, we address the problem of manipulation-enhanced semantic mapping, where a robot has to efficiently identify all objects in a cluttered shelf. Although Partially Observable Markov Decision Processes~(POMDPs) are standard for decision-making under uncertainty, representing unstructured interactive worlds remains challenging in this formalism. To tackle this, we define a POMDP whose belief is summarized by a metric-semantic grid map and propose a novel framework that uses neural networks to perform map-space belief updates to reason efficiently and simultaneously about object geometries, locations, categories, occlusions, and manipulation physics. Further, to enable accurate information gain analysis, the learned belief updates should maintain calibrated estimates of uncertainty. Therefore, we propose Calibrated Neural-Accelerated Belief Updates (CNABUs) to learn a belief propagation model that generalizes to novel scenarios and provides confidence-calibrated predictions for unknown areas. Our experiments show that our novel POMDP planner improves map completeness and accuracy over existing methods in challenging simulations and successfully transfers to real-world cluttered shelves in zero-shot fashion.

语义地图强化学习机器人操作不确定性建模

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。