arXiv:2410.15178cs.ROcs.AI2024-10中稿 · publication at RAL被引 4

让机器人根据任务需求动态调整定位精度,提升复杂环境导航成功率。

GUIDEd Agents: Enhancing Navigation Policies through Task-Specific Uncertainty Abstraction in Localization-Limited Environments

  • 用任务特定不确定性地图抽象不同区域的定位精度要求。
  • 在真实机器人任务中,任务完成率显著高于不考虑不确定性的基线方法。
  • 适合需要在资源受限下高效导航的自主系统研究者。

自主机器人在复杂环境中执行导航任务时,常因状态估计不确定性面临挑战。在隐身行动或资源受限场景中,高精度定位成本高昂,迫使机器人依赖低精度状态估计。我们的核心观察是:不同任务对不同区域的定位精度需求各异——例如,在拥挤空间中靠近障碍物需高精度,其他区域则可容忍较低精度。本文提出一种将任务特定不确定性要求直接融入导航策略的规划方法。引入任务特定不确定性地图(TSUM),通过领域自适应编码器生成共享表示空间,抽象各区域可接受的状态估计不确定性水平。基于TSUM,提出广义不确定性融合决策与执行框架(GUIDE),将不确定性要求嵌入机器人决策过程。实验表明,TSUM能有效抽象任务需求,使策略能根据上下文权衡确定性价值并自适应行为。将GUIDE集成至强化学习框架后,代理可在无需显式奖励设计的情况下,学习到兼顾任务完成与不确定性管理的导航策略。在多个真实机器人导航任务中评估,相比未显式考虑任务特定不确定性的基线方法,其任务完成率显著提升。

原文摘要 · Abstract (English)

Autonomous vehicles performing navigation tasks in complex environments face significant challenges due to uncertainty in state estimation. In many scenarios, such as stealth operations or resource-constrained settings, accessing high-precision localization comes at a significant cost, forcing robots to rely primarily on less precise state estimates. Our key observation is that different tasks require varying levels of precision in different regions: a robot navigating a crowded space might need precise localization near obstacles but can operate effectively with less precision elsewhere. In this paper, we present a planning method for integrating task-specific uncertainty requirements directly into navigation policies. We introduce Task-Specific Uncertainty Maps (TSUMs), which abstract the acceptable levels of state estimation uncertainty across different regions. TSUMs align task requirements and environmental features using a shared representation space, generated via a domain-adapted encoder. Using TSUMs, we propose Generalized Uncertainty Integration for Decision-Making and Execution (GUIDE), a policy conditioning framework that incorporates these uncertainty requirements into robot decision-making. We find that TSUMs provide an effective way to abstract task-specific uncertainty requirements, and conditioning policies on TSUMs enables the robot to reason about the context-dependent value of certainty and adapt its behavior accordingly. We show how integrating GUIDE into reinforcement learning frameworks allows the agent to learn navigation policies that effectively balance task completion and uncertainty management without explicit reward engineering. We evaluate GUIDE on various real-world robotic navigation tasks and find that it demonstrates significant improvement in task completion rates compared to baseline methods that do not explicitly consider task-specific uncertainty.

自主导航不确定性建模强化学习机器人

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。