arXiv:2505.09760cs.ROcs.NE2025-05

用神经网络实现可自检的技能记忆,让机器人像人一样灵活安全地执行动作。

Neural Associative Skill Memories for safer robotics and modelling human sensorimotor repertoires

  • 基于预测编码的神经架构,自动识别并表达多种运动技能。
  • 无需显式选择技能,即可在执行中检测异常,表现接近传统RNN。
  • 适合研究人机协作、安全机器人及生物运动学习的计算模型。

现代机器人面临与人类相似的挑战:需学习并自适应地表现多种感知-运动技能。赋予机器人类似人类对典型动作的体验记忆,有助于其识别正常运行状态,推动更安全的自我保护型机器人发展。现有关联技能记忆(ASMs)依赖预设技能库,难以统一学习与执行。本文提出神经关联技能记忆(Neural ASMs),采用自监督预测编码进行时序预测,统一技能学习与表达,使用类脑学习规则。相比传统方法,该模型无需显式技能选择,通过上下文推理隐式识别技能,实现跨已学行为的故障检测。性能上,与基于时间反向传播的循环神经网络相当,且符合生物合理的速度-精度权衡。该工作推进神经机器人学发展,展示预测编码如何建模自适应控制与人类运动准备,并将故障检测、反应控制、技能记忆与表达整合于单一能量架构中,为安全机器人与生物运动学习提供计算视角。

原文摘要 · Abstract (English)

Modern robots face challenges shared by humans, where machines must learn multiple sensorimotor skills and express them adaptively. Equipping robots with a human-like memory of how it feels to do multiple stereotypical movements can make robots more aware of normal operational states and help develop self-preserving safer robots. Associative Skill Memories (ASMs) aim to address this by linking movement primitives to sensory feedback, but existing implementations rely on hard-coded libraries of individual skills. A key unresolved problem is how a single neural network can learn a repertoire of skills while enabling fault detection and context-aware execution. Here we introduce Neural Associative Skill Memories (ASMs), a framework that utilises self-supervised predictive coding for temporal prediction to unify skill learning and expression, using biologically plausible learning rules. Unlike traditional ASMs which require explicit skill selection, Neural ASMs implicitly recognize and express skills through contextual inference, enabling fault detection across learned behaviours without an explicit skill selection mechanism. Compared to recurrent neural networks trained via backpropagation through time, our model achieves comparable qualitative performance in skill memory expression while using local learning rules and predicts a biologically relevant speed-accuracy trade-off during skill memory expression. This work advances the field of neurorobotics by demonstrating how predictive coding principles can model adaptive robot control and human motor preparation. By unifying fault detection, reactive control, skill memorisation and expression into a single energy-based architecture, Neural ASMs contribute to safer robotics and provide a computational lens to study biological sensorimotor learning.

机器人神经网络技能记忆安全

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。