用动态状态空间和混合动作域的POMDP提升机器人在复杂室内找物效率。
POMDP-based Object Search with Growing State Space and Hybrid Action Domain

- 构建动态扩展的状态空间与连续离散混合动作域的POMDP模型。
- 通过神经过程过滤+k中心聚类,在3D环境中高效搜索目标,比基线快30%以上。
- 适合需要高可靠性定位的移动机器人任务,尤其适用真实办公环境。
在包含货架、桌子、床等多样化家具的复杂室内环境中,高效定位目标物体是移动机器人的重大挑战,源于定位误差、视野受限和视觉遮挡等因素。本文将该任务建模为具有动态扩展状态空间和混合(连续与离散)动作空间的高维部分可观测马尔可夫决策过程(POMDP)。基于精心设计的感知模块,提出一种新型在线POMDP求解器——增长神经过程滤波的k中心聚类树(GNPF-kCT)。通过蒙特卡洛树搜索(MCTS)结合信念树复用以应对状态空间增长,利用神经过程网络过滤无效基础动作,并采用k中心聚类超球面离散化实现高维动作空间的高效精炼。引入改进的上置信界(UCB)策略,依据信念差异与动作价值函数在估计直径单元内的表现进行扩展。理论分析验证了方法的收敛性与性能潜力。针对信息或奖励有限的场景,提出基于网格世界模型的猜测目标物体策略以提升搜索效率。大量Gazebo仿真测试显示,在相同计算约束与感知系统下,本方法比基于POMDP的基线及先进非POMDP方法(包括大语言模型方法)在目标定位速度与可靠性上均有显著提升。真实办公室环境测试进一步验证了方法的实用性。
原文摘要 · Abstract (English)
Efficiently locating target objects in complex indoor environments with diverse furniture, such as shelves, tables, and beds, is a significant challenge for mobile robots. This difficulty arises from factors like localization errors, limited fields of view, and visual occlusion. We address this by framing the object-search task as a highdimensional Partially Observable Markov Decision Process (POMDP) with a growing state space and hybrid (continuous and discrete) action spaces in 3D environments. Based on a meticulously designed perception module, a novel online POMDP solver named the growing neural process filtered k-center clustering tree (GNPF-kCT) is proposed to tackle this problem. Optimal actions are selected using Monte Carlo Tree Search (MCTS) with belief tree reuse for growing state space, a neural process network to filter useless primitive actions, and k-center clustering hypersphere discretization for efficient refinement of high-dimensional action spaces. A modified upper-confidence bound (UCB), informed by belief differences and action value functions within cells of estimated diameters, guides MCTS expansion. Theoretical analysis validates the convergence and performance potential of our method. To address scenarios with limited information or rewards, we also introduce a guessed target object with a grid-world model as a key strategy to enhance search efficiency. Extensive Gazebo simulations with Fetch and Stretch robots demonstrate faster and more reliable target localization than POMDP-based baselines and state-of-the-art (SOTA) non-POMDP-based solvers, especially large language model (LLM) based methods, in object search under the same computational constraints and perception systems. Real-world tests in office environments confirm the practical applicability of our approach. Project page: https://sites.google.com/view/gnpfkct.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。