arXiv:2512.07032cs.RO2025-12

用神经形态信号构建机器人记忆模型,实现低耗高效的动作决策。

A Hetero-Associative Sequential Memory Model Utilizing Neuromorphic Signals: Validated on a Mobile Manipulator

  • 用群体位置编码和脉冲率特征绑定关节状态与触觉信息
  • 在二值空间中通过旋转嵌入实现触觉方向感知的模糊检索
  • 适用于移动机械臂快速训练与多关节抓取序列生成

本文提出一种异关联序列记忆系统,用于移动机械臂,通过紧凑的神经形态绑定将机器人关节状态与触觉观测关联,实现低计算与内存开销的分步动作决策。该方法利用群体位置编码表示关节角度,并通过伊兹基维奇神经元模型将皮肤测得的力转化为脉冲率特征;两者均转换为双极二进制向量,并逐元素绑定,形成存储于大容量序列记忆中的关联。为提升二值空间中的可区分性并注入触觉几何信息,引入3D旋转位置嵌入,根据感知力的方向旋转子空间,实现基于软最大值加权的时移动作模式回忆。在覆盖机器人皮肤的丰田人机助手机器人上,该系统实现了伪顺应控制器,使连杆在受触时沿施力方向以与力幅值相关的速度移动,并可通过持续触觉输入回溯多关节抓取序列。系统可快速搭建,从状态与观测的同步流中训练,展现出一定泛化能力且资源经济。结果表明,可通过关联回忆执行单关节与全臂行为,提示其在模仿学习、运动规划与多模态融合中的扩展潜力。

原文摘要 · Abstract (English)

This paper presents a hetero-associative sequential memory system for mobile manipulators that learns compact, neuromorphic bindings between robot joint states and tactile observations to produce step-wise action decisions with low compute and memory cost. The method encodes joint angles via population place coding and converts skin-measured forces into spike-rate features using an Izhikevich neuron model; both signals are transformed into bipolar binary vectors and bound element-wise to create associations stored in a large-capacity sequential memory. To improve separability in binary space and inject geometry from touch, we introduce 3D rotary positional embeddings that rotate subspaces as a function of sensed force direction, enabling fuzzy retrieval through a softmax weighted recall over temporally shifted action patterns. On a Toyota Human Support Robot covered by robot skin, the hetero-associative sequential memory system realizes a pseudocompliance controller that moves the link under touch in the direction and with speed correlating to the amplitude of applied force, and it retrieves multi-joint grasp sequences by continuing tactile input. The system sets up quickly, trains from synchronized streams of states and observations, and exhibits a degree of generalization while remaining economical. Results demonstrate single-joint and full-arm behaviors executed via associative recall, and suggest extensions to imitation learning, motion planning, and multi-modal integration.

神经形态计算机器人控制序列记忆触觉感知

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。