arXiv:2607.24841cs.CLcs.LG2026-07中稿 · presentation at 20…

通过稀疏脉冲计算与分块去噪,提升大模型推理效率。

Neuromorphic Diffusion Language Models: Addressing Compute and Memory Bottlenecks via Sparsity and Block Denoising

论文配图:Neuromorphic Diffusion Language Models: Addressing Compute and Memory Bottlenecks via Sparsity and Block Denoising
图 1 · 摘自论文原文
  • 结合分块去噪与脉冲稀疏性,减少参数访问和计算量。
  • 在翻译任务中,能效与吞吐量显著优于传统自回归模型。
  • 适合关注低功耗、高并发推理的硬件研发与系统设计者。

自回归大语言模型在推理时效率低下,因每个生成词元需访问全部模型参数,导致运算强度低且能耗高。掩码扩散语言模型(MDLMs)通过允许每次参数访问生成多个词元,部分缓解了内存瓶颈。本文提出神经形态MDLM(N-MDLM),融合分块扩散与基于脉冲的神经形态计算,联合提升吞吐量与能效。分块扩散通过并行生成多个词元提高吞吐,脉冲稀疏性则通过跳过不活跃通道降低有效参数流量与计算量。我们构建了一种词元级的类屋顶线模型,分析稀疏性与扩散的协同效应。实验显示,在翻译任务中,得益于脉冲稀疏性,即使在计算密集型平台,N-MDLM仍显著优于自回归模型,实现能效与吞吐双提升。

原文摘要 · Abstract (English)

Autoregressive (AR) large language models (LLMs) are inherently inefficient at inference time because each generated token requires accessing the full set of model parameters, leading to low operational intensity and high energy consumption. Masked diffusion language models (MDLMs) partially address this limitation for memory-bound settings by allowing multiple tokens to be generated per parameter access. In order to further enhance inference efficiency on modern platforms with extensive in-chip memory, this work proposes neuromorphic MDLMs (N-MDLMs), which integrate block diffusion with spike-based neuromorphic computation to jointly improve throughput and energy efficiency. While block diffusion increases token throughput by producing multiple tokens per parameter access, spike-induced sparsity reduces effective parameter traffic and computations by skipping inactive channels. To analyze the synergistic effect of sparsity and diffusion, we develop a token-level roofline-inspired model that captures the combined impact of block-parallel generation and spike sparsity on decoding efficiency. Experimental results on translation tasks show that, thanks to spike-induced sparsity, N-MDLMs achieve substantial improvements in energy efficiency and throughput even in compute-bound platforms for which MDLMs would fail to improve over AR-LLMs.

神经形态计算扩散模型推理优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。