arXiv:2602.08817cs.LG2026-02被引 2

将大模型转为低功耗脉冲神经网络,实现零精度损失的高效推理。

Kirin: Improving ANN efficiency with SNN Hybridization

  • 用整数与脉冲混合编码,减少脉冲时间窗长度,降低延迟。
  • 在W4A4&8量化下,能耗降低84.66%,推理步数减少93.75%,精度接近浮点16位。
  • 适合追求高能效、低延迟的边缘AI部署场景。

人工神经网络(ANN),尤其是大语言模型(LLM),具备强大推理能力但能耗高。脉冲神经网络(SNN)因二值化和事件驱动特性具有优异能效,促使研究从ANN到SNN的转换。该过程中的量化至关重要,通过时间维度将浮点参数映射为离散的SNN参数。然而仍面临挑战:(i) 高比特量化转为二值脉冲需更长时间窗,增加系统延迟;(ii) 单脉冲方案信息损失与多脉冲方案能耗之间存在固有权衡。为此,我们提出Kirin——一种基于整数与脉冲混合的SNN架构,实现无精度损失的高效转换。首先,提出脉冲矩阵混合策略,将低比特参数以小时间窗的二值脉冲编码,其余保持整数格式,从而降低整体执行延迟;其次,引入静默阈值机制调控单脉冲触发时机,确保输出数学等价于原LLM,维持精度。实验表明,在W4A4&8量化设置下,Kirin实现接近FP16精度,能耗降低最高达84.66%,时间步数减少93.75%。

原文摘要 · Abstract (English)

Artificial neural networks (ANNs), particularly large language models (LLMs), demonstrate powerful inference capabilities but consume substantial energy. Conversely, spiking neural networks (SNNs) exhibit exceptional energy efficiency due to their binary and event-driven characteristics, thus motivating the study of ANN-to-SNN conversion. In this process, quantization plays a pivotal role, mapping LLMs' floating-point parameters to discrete SNN parameters via the temporal dimension of the time window. However, several challenges remain in the conversion process: (i) converting high bit-width quantization values into binary spikes requires longer time windows, increasing system latency; and (ii) the inherent trade-off between the information loss of single-spike schemes and the energy costs of multi-spike ones in SNN. To address these challenges, we propose Kirin, a integer and spike hybrid based SNN to achieve accuracy lossless ANN-to-SNN conversion with time and energy efficiency. Specifically, we first propose a Spike Matrix Hybridization strategy that encoding low bit-width parameters that leading to small time window size into binary spikes while preserving the rest in integer format, thereby reducing the overall latency of SNN execution. Second, we introduce a silence threshold mechanism to regulate the timing of single-spike firing, ensuring the output is mathematically equivalent to the LLM's output and preserves accuracy. Experimental results demonstrate that Kirin, under a W4A4\&8 quantization setting, achieves near-FP16 accuracy while reducing energy consumption by up to 84.66\% and shortening time steps by 93.75\%.

神经网络能效优化脉冲神经网络量化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。