arXiv:2605.22206cs.NEcs.AI2026-05

用脉冲时间编码模拟触觉推理,让机器像人一样通过移动感知物体空间结构。

Temporal Coding as a Substrate for Sensorimotor Object Inference: A Spiking Reinterpretation of Thousand Brains Architecture

  • 用脉冲发放顺序替代密集向量,用时间差隐含表示传感器位移。
  • 在特征相同但排列不同的物体上实现100%识别准确率,传统方法仅随机水平。
  • 自适应参数λ能反映物体几何复杂度,适合生物可解释的智能系统研究。

千脑理论(TBT)及其开源框架Monty通过主动移动传感器接触物体表面进行对象识别,逐点积累证据。当前实现将每个接触点编码为密集浮点向量,忽略接触顺序的语义信息。在TBT中,接触序列具有空间意义:例如从左到右感知到特征A在B之前,说明A位于B左侧。密集向量丢失了这一时序信息。本文提出用排名顺序脉冲包替代:每个接触产生短暂神经事件,最强激活神经元率先放电,后续脉冲的时间间隔隐式编码位移,无需显式坐标计算。基于生物启发的STDP学习规则将遍历方向编码至突触权重。可学习参数λ调节对早期与近期接触的依赖程度,适配不同物体几何结构。推导出三项可验证预测,并在约450行NumPy代码中实现四个组件。三组合成实验验证核心主张:时序编码在特征相同但空间排列不同的物体上实现100%区分准确率,而密集累积仅达随机水平;在所有噪声水平下保持30-50个百分点优势;自适应λ收敛至不同取值,反映物体几何复杂度。蒙蒂框架的YCB基准端到端评估留待未来工作。

原文摘要 · Abstract (English)

The Thousand Brains Theory (TBT) and its open-source Monty framework model object recognition through sensorimotor inference -- identifying objects by actively moving a sensor across their surface and building evidence contact by contact. The current implementation encodes each contact as a dense floating-point vector. While Monty tracks inter-step displacement and accumulates evidence across contacts, it treats the feature activation pattern at each contact as an unordered set - the directional sequence in which features are encountered carries no representational weight. In TBT, the sequence of contacts carries spatial meaning: knowing that feature A was felt before feature B during a left-to-right sweep tells you something about where A and B sit on the object. Dense vectors discard this ordering. We propose replacing dense vectors with rank-order spike packets: each contact produces a brief burst of neural events where the most strongly activated neuron fires first. The time gap between successive bursts implicitly encodes sensor displacement without explicit coordinate calculations. A biologically motivated learning rule (STDP) encodes traversal direction into synaptic weights. A learnable parameter lambda adjusts reliance on earlier versus recent contacts, adapting to each object's geometry. We derive three testable predictions and specify an implementation of four components in approximately 450 lines of NumPy. Three synthetic experiments confirm the core claims: temporal coding achieves perfect discrimination accuracy on objects with identical features in different spatial arrangements, where dense accumulation performs at chance; temporal coding maintains a 30-50 percentage point advantage across all tested noise levels; the adaptive lambda converges to distinct values, reflecting object geometric complexity. End-to-end evaluation on Monty's YCB benchmark is left for future work.

神经编码触觉推理脉冲神经网络时空编码

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。