arXiv:2409.11604cs.RO2024-09被引 1

让机器人根据已知环境预测未知区域,动态调整决策策略。

Context-Generative Default Policy for Bounded Rational Agent

  • 用扩散模型预测未观测环境,生成可适应的默认策略
  • 在真实无人机测试中有效避开未知障碍物,优于基线方法
  • 适合复杂未知环境中需要灵活决策的机器人系统

受限理性智能体通常通过评估有限选择集做出决策,这些选择基于先前经验形成的静态默认策略。然而,这种静态策略在未知环境中面临显著挑战。本文提出一种上下文生成式默认策略,利用机器人已观测区域预测未观测部分环境,从而根据实际观测地图与想象中的未观测地图动态调整默认策略。借助受限理性框架的自适应特性,机器人可对不可靠或错误的预测进行筛选,仅在默认策略附近采样少数轨迹。方法采用扩散模型进行地图预测,并结合基于采样的规划与B样条轨迹优化生成默认策略。大量实验表明,该策略在识别和避让未知障碍物方面优于基线方法。真实世界实验使用Crazyflie无人机验证了本方法在训练分布外环境中的适应能力。

原文摘要 · Abstract (English)

Bounded rational agents often make decisions by evaluating a finite selection of choices, typically derived from a reference point termed the $`$default policy,' based on previous experience. However, the inherent rigidity of the static default policy presents significant challenges for agents when operating in unknown environment, that are not included in agent's prior knowledge. In this work, we introduce a context-generative default policy that leverages the region observed by the robot to predict unobserved part of the environment, thereby enabling the robot to adaptively adjust its default policy based on both the actual observed map and the $\textit{imagined}$ unobserved map. Furthermore, the adaptive nature of the bounded rationality framework enables the robot to manage unreliable or incorrect imaginations by selectively sampling a few trajectories in the vicinity of the default policy. Our approach utilizes a diffusion model for map prediction and a sampling-based planning with B-spline trajectory optimization to generate the default policy. Extensive evaluations reveal that the context-generative policy outperforms the baseline methods in identifying and avoiding unseen obstacles. Additionally, real-world experiments conducted with the Crazyflie drones demonstrate the adaptability of our proposed method, even when acting in environments outside the domain of the training distribution.

机器人决策扩散模型路径规划

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。