用稀疏脉冲网络提升3D核磁图像神经浸润预测效率
SpikeDS: Dual Sparsity Spikformer for Perineural Invasion Prediction in 3D MRI

- 结合激活稀疏与窗口稀疏,设计双稀疏脉冲注意力机制
- 在139例患者数据上达0.753 AUC,仅耗电14.4毫焦
- 适合医疗边缘设备部署,兼顾精度与能效
胆管癌中神经周围浸润(PNI)与不良预后相关,但其在3D MRI中的表现细微且空间分布不均,检测困难。现有深度学习方法对体数据计算成本高,难以临床应用。本文提出双稀疏脉冲视觉变压器(SpikeDS),通过二值脉冲通信的激活稀疏性与基于发放率的窗口剪枝实现空间稀疏性。引入双稀疏脉冲注意力(DSSA),包含仅对高发放率显著窗口施加注意力的窗口专家混合脉冲注意力(W-EMSA),以及允许被剪枝窗口仍作为键值来源的跨窗口脉冲自注意力(CW-SSA)。在139例胆管癌患者的临床队列中,经5折交叉验证,SpikeDS达到0.753 AUC,能耗仅14.4毫焦,优于最佳基线模型,在诊断性能与能效上均占优。结果表明,双稀疏策略为3D脉冲变压器提供了高效且硬件友好的优化路径。
原文摘要 · Abstract (English)
Perineural invasion (PNI) is associated with poor prognosis in cholangiocarcinoma (CCA). However, its detection from 3D MRI remains challenging due to the subtle and spatially heterogeneous imaging signatures at the tumor periphery. Capturing such spatially sparse cues necessitates volumetric analysis of 3D MRI, but existing deep learning approaches incur prohibitive computational costs on volumetric medical images, limiting their clinical deployment. We propose Dual Sparsity Spikformer (SpikeDS), a spiking neural network architecture that jointly exploits activation sparsity from binary spike communication and spatial sparsity from window pruning based on firing rates. SpikeDS introduces Dual Sparsity Spiking Attention (DSSA), which combines two complementary mechanisms. The first is Window-based Expert Mixture Spiking Attention (W-EMSA), which selectively applies attention only to salient windows identified by their firing rates. The second is Cross-Window Spiking Self-Attention (CW-SSA), which enables global context exchange through an asymmetric scheme in which pruned windows still contribute as key-value sources. Evaluated on a clinical cohort of 139 CCA patients via 5-fold cross-validation, SpikeDS achieves an AUC of 0.753 while consuming only 14.4 mJ, surpassing the best baseline in both AUC and energy efficiency. These results suggest that dual sparsity provides an effective hardware-aware strategy for improving the efficiency of 3D spiking transformers without compromising diagnostic performance.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。