分层控制架构解决不确定环境下机器人的安全避障与信息获取难题
Safety-critical Control Under Partial Observability: Reach-Avoid POMDP meets Belief Space Control
- 将目标达成、信息收集、安全性解耦为独立模块,分别用信念空间控制函数建模
- 在超过10^4维的非高斯信念表示下仍实现实时求解,任务成功率显著提升
- 适用于航天机器人等对安全性和实时性要求高的场景
部分可观测马尔可夫决策过程(POMDP)为不确定性下的机器人决策提供了严谨框架。然而,求解可达-避免型POMDP需协调目标达成、安全性与主动信息获取三种行为。现有在线求解器尝试在单一信念树搜索中统一处理三者,但因目标时间尺度冲突而效果受限。本文提出一种分层、基于证书的信念空间控制架构,将目标达成、信息获取与安全性解耦为模块化组件。引入信念控制李雅普诺夫函数(BCLFs),将信息获取形式化为信念空间中的李雅普诺夫收敛问题,并通过强化学习实现学习;针对安全性,设计信念控制屏障函数(BCBFs),利用保形预测提供有限时域的概率安全保证。最终控制合成简化为轻量级二次规划,可在实时内求解,即使面对维度大于10^4的非高斯信念表示。仿真与航天机器人平台实验表明,该方法具备实时性能,相比现有约束型POMDP求解器在安全性和任务成功率上均有显著提升。
原文摘要 · Abstract (English)
Partially Observable Markov Decision Processes (POMDPs) provide a principled framework for robot decision-making under uncertainty. Solving reach-avoid POMDPs, however, requires coordinating three distinct behaviors: goal reaching, safety, and active information gathering to reduce uncertainty. Existing online POMDP solvers attempt to address all three within a single belief tree search, but this unified approach struggles with the conflicting time scales inherent to these objectives. We propose a layered, certificate-based control architecture that operates directly in belief space, decoupling goal reaching, information gathering, and safety into modular components. We introduce Belief Control Lyapunov Functions (BCLFs) that formalize information gathering as a Lyapunov convergence problem in belief space, and show how they can be learned via reinforcement learning. For safety, we develop Belief Control Barrier Functions (BCBFs) that leverage conformal prediction to provide probabilistic safety guarantees over finite horizons. The resulting control synthesis reduces to lightweight quadratic programs solvable in real time, even for non-Gaussian belief representations with dimension $>10^4$. Experiments in simulation and on a space-robotics platform demonstrate real-time performance and improved safety and task success compared to state-of-the-art constrained POMDP solvers.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。