arXiv:2508.10747cs.AIcs.RO2025-08中稿 · publication in Int…

用稀疏图网络提升强化学习在大场景规划中的可扩展性

Scaling Up without Fading Out: Goal-Aware Sparse GNN for RL-based Generalized Planning

  • 构建目标感知的稀疏图结构,只保留关键局部关系
  • 在100×100网格上成功实现规划,远超原有方法
  • 适合大规模真实场景的智能体规划任务

结合深度强化学习与图神经网络的通用规划在多种符号规划领域(由PDDL描述)中展现出良好效果。然而,现有方法通常将规划状态表示为全连接图,导致边信息呈组合爆炸式增长,问题规模扩大时出现严重稀疏性,尤其在大网格环境中尤为明显。这种密集表示造成节点信息稀释、内存需求指数级上升,使大规模问题学习变得不可行。为此,我们提出一种稀疏、目标感知的GNN表示方法,仅编码相关局部关系,并显式融入与目标相关的空间特征。通过在网格世界中基于PDDL设计新型无人机任务场景,有效模拟真实任务执行环境。实验结果表明,该方法能有效扩展至此前密集图表示无法处理的大网格规模,显著提升策略泛化能力与成功率。研究为解决现实中的大规模通用规划任务提供了实用基础。

原文摘要 · Abstract (English)

Generalized planning using deep reinforcement learning (RL) combined with graph neural networks (GNNs) has shown promising results in various symbolic planning domains described by PDDL. However, existing approaches typically represent planning states as fully connected graphs, leading to a combinatorial explosion in edge information and substantial sparsity as problem scales grow, especially evident in large grid-based environments. This dense representation results in diluted node-level information, exponentially increases memory requirements, and ultimately makes learning infeasible for larger-scale problems. To address these challenges, we propose a sparse, goal-aware GNN representation that selectively encodes relevant local relationships and explicitly integrates spatial features related to the goal. We validate our approach by designing novel drone mission scenarios based on PDDL within a grid world, effectively simulating realistic mission execution environments. Our experimental results demonstrate that our method scales effectively to larger grid sizes previously infeasible with dense graph representations and substantially improves policy generalization and success rates. Our findings provide a practical foundation for addressing realistic, large-scale generalized planning tasks.

强化学习图神经网络规划稀疏建模

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。