用离散脉冲网络提升视觉定位召回率,实现100%精确率下的完美闭环
Visual Place Recognition Using Rate-Encoded Spiking Neural Networks with Discrete STDP Learning

- 采用离散时序的脉冲神经网络与确定性张量流水线分配神经元
- 在100个地点的Nordland数据集上实现R@100P=100.00%
- 适合对低延迟、高精度自主导航有要求的边缘设备应用
基于无监督脉冲时间依赖可塑性(STDP)训练的脉冲神经网络(SNN)被探索用于解决视觉回环检测问题,其潜力在于可在类脑硬件上实现高效本地推理。现有最先进的STDP模型虽具备高分类准确率,但未能达到可靠自主导航所需的高召回率-100%精确率(R@100P)。本文提出一种基于PyTorch与snnTorch的离散、张量原生的STDP-SNN-VPR流程,在100个地点的Nordland数据集上使用15个独立训练的网络进行评估。研究了三个关键设计选择的影响:首先,采用闭式确定性张量流水线进行神经元分配,相比标准argmax方法显著提升R@100P;其次,每个查询后重置状态可独立提升R@100P;第三,通过速度补偿的滑动窗口聚合连续k帧,在常速遍历下当k=5时达到R@100P=100.00%,仅增加0.20毫秒延迟。综合表明,推理阶段设计对STDP-SNN-VPR的召回-精确率有显著影响,但各机制的独立贡献及实现差异仍需进一步分析。
原文摘要 · Abstract (English)
Spiking Neural Networks (SNNs) trained through unsupervised Spike-Timing-Dependent Plasticity (STDP) have been explored as solutions to visual loop closure problems, driven by the prospect of efficient on-device inference on neuromorphic devices. State-of-the-art STDP-based models deliver high classification accuracy but fail to reach the high Recall at 100% Precision (R@100P) needed for reliable autonomous navigation. We present a discrete, tensor-native implementation of the STDP-based SNN-VPR pipeline using PyTorch with snnTorch and evaluate it on a 100-place Nordland dataset using 15 independently-trained networks. The contribution of three decisions in the implementation is investigated. First, we show how to perform neuron assignment with a closed-form, deterministic tensor pipeline and show that it provides significantly higher R@100P than a standard argmax procedure. However, some of this gain comes from implementation differences compared to prior continuous-time models, which we measure independently. Second, ablation in isolation shows that state reset after each query helps improve R@100P regardless of the way neurons are assigned. Third, velocity-compensated sliding window aggregation over k consecutive frames reaches R@100P = 100.00% at k = 5 for constant-velocity traversal and an additional 0.20 ms latency. Taken together, these findings show the impact of inference stage design decisions in STDP-based SNN-VPR on recall precision, although the separate contribution of each mechanism and implementation differences is only partially disentangled and needs further examination.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。