arXiv:2510.27191cs.ROcs.AI2025-10中稿 · ICRA被引 3

让机器人在信息不全时高效决策,速度提升20倍以上。

Vectorized Online POMDP Planning

  • 将规划过程转为张量运算,彻底消除并行计算依赖
  • 相比顶尖并行算法快20倍,用1/1000预算达同样效果
  • 适合需要实时决策的机器人系统开发

部分可观测马尔可夫决策过程(POMDP)是自主机器人在信息不全情况下进行规划的核心框架,能处理动作的随机性与观测噪声。现有求解器因需交替进行动作优化与价值估计,导致并行计算中存在依赖和同步瓶颈,难以发挥硬件并行优势。本文提出向量化在线POMDP规划器(VOPP),基于新提出的POMDP公式,将优化中的部分问题解析求解,仅保留期望估计的数值计算。VOPP将所有规划数据结构表示为张量,所有规划步骤均以完全向量化方式执行,实现无依赖、无同步瓶颈的大规模并行。实验表明,VOPP在生成近似最优解方面比现有最先进并行在线求解器至少快20倍;同时,其性能优于最先进的串行在线求解器,且规划预算仅为后者的1/1000。

原文摘要 · Abstract (English)

Planning under partial observability is an essential capability of autonomous robots. The Partially Observable Markov Decision Process (POMDP) provides a powerful framework for planning under partial observability problems, capturing the stochastic effects of actions and the limited information available through noisy observations. POMDP solving could benefit tremendously from massive parallelization on today's hardware, but parallelizing POMDP solvers has been challenging. Most solvers rely on interleaving numerical optimization over actions with the estimation of their values, which creates dependencies and synchronization bottlenecks between parallel processes that can offset the benefits of parallelization. In this paper, we propose Vectorized Online POMDP Planner (VOPP), a novel parallel online solver that leverages a recent POMDP formulation which analytically solves part of the optimization component, leaving numerical computations to consist of only estimation of expectations. VOPP represents all data structures related to planning as a collection of tensors, and implements all planning steps as fully vectorized computations over this representation. The result is a massively parallel online solver with no dependencies or synchronization bottlenecks between concurrent processes. Experimental results indicate that VOPP is at least $20\times$ more efficient in computing near-optimal solutions compared to an existing state-of-the-art parallel online solver. Moreover, VOPP outperforms state-of-the-art sequential online solvers, while using a planning budget that is $1000\times$ smaller.

机器人规划POMDP并行计算向量化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。