arXiv:2505.15211cs.RO2025-05IJCAI被引 14

提出GCNT模型,让机器人控制器通用化且适应不同形态。

GCNT: Graph-Based Transformer Policies for Morphology-Agnostic Reinforcement Learning

  • 用图卷积与Transformer融合提取机器人形态信息
  • 在2个基准上8项任务表现最佳,支持零样本泛化
  • 适合研发可通用的智能机器人控制器的研究者

为不同形态的机器人训练通用控制器是提升系统鲁棒性的重要方向。然而,不同形态导致状态空间和动作空间维度各异,传统策略网络难以适配。现有方法虽通过模块化处理,但未能充分提取和利用整体形态信息,而该信息对训练通用控制器至关重要。为此,本文提出基于改进图卷积网络(GCN)与Transformer的GCNT模型。利用GCN与Transformer均可处理任意数量模块的特性,实现对多样形态的兼容。核心思路是:GCN高效提取机器人形态特征,而Transformer使每个模块节点直接通信,确保信息充分利用。实验表明,该方法能生成多种配置机器人的稳定运动行为,并实现对训练中未见形态的零样本泛化。在两个标准基准测试中,GCNT在8项任务上取得最优性能。

原文摘要 · Abstract (English)

Training a universal controller for robots with different morphologies is a promising research trend, since it can significantly enhance the robustness and resilience of the robotic system. However, diverse morphologies can yield different dimensions of state space and action space, making it difficult to comply with traditional policy networks. Existing methods address this issue by modularizing the robot configuration, while do not adequately extract and utilize the overall morphological information, which has been proven crucial for training a universal controller. To this end, we propose GCNT, a morphology-agnostic policy network based on improved Graph Convolutional Network (GCN) and Transformer. It exploits the fact that GCN and Transformer can handle arbitrary number of modules to achieve compatibility with diverse morphologies. Our key insight is that the GCN is able to efficiently extract morphology information of robots, while Transformer ensures that it is fully utilized by allowing each node of the robot to communicate this information directly. Experimental results show that our method can generate resilient locomotion behaviors for robots with different configurations, including zero-shot generalization to robot morphologies not seen during training. In particular, GCNT achieved the best performance on 8 tasks in the 2 standard benchmarks.

强化学习通用控制图神经网络零样本

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。