用事件数据蒸馏加速脉冲神经网络训练,大幅降低耗时与存储开销。
Learning from Dense Events: Towards Fast Spiking Neural Networks Training via Event Dataset Distillation
- 提出PACE框架,通过相位对齐压缩事件数据集,实现快速训练
- 在N-MNIST上达84.4%准确率,训练时间减少50倍以上,存储降6000倍
- 适合边缘部署的轻量级脉冲神经网络训练,尤其适用于动态事件流
事件相机感知亮度变化并输出二值异步事件流,其生物启发特性与脉冲神经网络(SNN)高度契合,为传统视觉系统提供节能替代方案。然而,由于时间编码机制,SNN训练成本仍高,限制实际应用。为此,本文提出首个面向事件视觉与SNN的数据集蒸馏框架PACE(Phase-Aligned Condensation for Events)。PACE通过两个核心模块:ST-DSM利用残差膜电位增强脉冲特征密度并实现精细时空匹配;PEQ-N提供即插即用的直通概率整数量化器,兼容标准事件帧流水线。在DVS-Gesture、CIFAR10-DVS和N-MNIST数据集上,PACE优于现有核心集选择与数据蒸馏方法,尤其在动态事件流及低中等每类样本数(IPC)条件下表现突出。在N-MNIST上达到84.4%准确率,约为全量训练集性能的85%,训练时间减少超过50倍,存储成本降低6000倍,生成紧凑代理数据集,支持分钟级SNN训练与高效边缘部署。
原文摘要 · Abstract (English)
Event cameras sense brightness changes and output binary asynchronous event streams, attracting increasing attention. Their bio-inspired dynamics align well with spiking neural networks (SNNs), offering a promising energy-efficient alternative to conventional vision systems. However, SNNs remain costly to train due to temporal coding, which limits their practical deployment. To alleviate the high training cost of SNNs, we introduce \textbf{PACE} (Phase-Aligned Condensation for Events), the first dataset distillation framework to SNNs and event-based vision. PACE distills a large training dataset into a compact synthetic one that enables fast SNN training, which is achieved by two core modules: \textbf{ST-DSM} and \textbf{PEQ-N}. ST-DSM uses residual membrane potentials to densify spike-based features (SDR) and to perform fine-grained spatiotemporal matching of amplitude and phase (ST-SM), while PEQ-N provides a plug-and-play straight through probabilistic integer quantizer compatible with standard event-frame pipelines. Across DVS-Gesture, CIFAR10-DVS, and N-MNIST datasets, PACE outperforms existing coreset selection and dataset distillation baselines, with particularly strong gains on dynamic event streams and at low or moderate IPC. Specifically, on N-MNIST, it achieves \(84.4\%\) accuracy, about \(85\%\) of the full training set performance, while reducing training time by more than \(50\times\) and storage cost by \(6000\times\), yielding compact surrogates that enable minute-scale SNN training and efficient edge deployment.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。