arXiv:2410.07174q-bio.NCcs.AI2024-10被引 4

受哺乳动物神经回路启发的网络架构,让四足机器人更快学会走路。

Neural Circuit Architectural Priors for Quadruped Locomotion

  • 模仿哺乳动物肢体与脊髓神经回路设计网络结构
  • 参数量少一个数量级,训练数据更少但性能相当
  • 在真实机器人上直接部署无需仿真到现实迁移

基于强化学习的四足机器人行走控制通常采用全连接MLP等通用策略架构,缺乏先验知识,实践中常依赖奖励设计、训练课程或模仿数据。自然界中,动物出生即具备由进化塑造的神经系统架构,使其能快速掌握运动能力(如马出生数小时内即可行走)。本文提出一种受哺乳动物肢体与脊髓神经回路启发的生物启发式人工神经网络架构,该架构在初始性能和最终性能上均达到与MLP相当水平,但所需训练数据更少,参数量减少一个数量级。此外,其对任务变化具有更强泛化能力,甚至可在无标准“仿真到现实”迁移的情况下直接部署于真实机器人。结果表明,神经回路可为运动控制提供有效架构先验,推动未来在其他感觉运动技能中的应用。

原文摘要 · Abstract (English)

Learning-based approaches to quadruped locomotion commonly adopt generic policy architectures like fully connected MLPs. As such architectures contain few inductive biases, it is common in practice to incorporate priors in the form of rewards, training curricula, imitation data, or trajectory generators. In nature, animals are born with priors in the form of their nervous system's architecture, which has been shaped by evolution to confer innate ability and efficient learning. For instance, a horse can walk within hours of birth and can quickly improve with practice. Such architectural priors can also be useful in ANN architectures for AI. In this work, we explore the advantages of a biologically inspired ANN architecture for quadruped locomotion based on neural circuits in the limbs and spinal cord of mammals. Our architecture achieves good initial performance and comparable final performance to MLPs, while using less data and orders of magnitude fewer parameters. Our architecture also exhibits better generalization to task variations, even admitting deployment on a physical robot without standard sim-to-real methods. This work shows that neural circuits can provide valuable architectural priors for locomotion and encourages future work in other sensorimotor skills.

四足行走神经回路架构先验仿生智能

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。