用脉冲神经网络实现低功耗、无后处理的清晰边缘检测
MS2Edge: Towards Energy-Efficient and Crisp Edge Detection with Multi-Scale Residual Learning in SNNs
- 基于多尺度残差结构的脉冲神经网络,恢复断裂边缘
- 在多个数据集上超越传统方法,保持超低能耗
- 适合边缘检测场景下的嵌入式设备部署
基于人工神经网络(ANN)的边缘检测虽取得显著进展,但仍面临两大挑战:一是需在大规模数据上预训练并依赖复杂先验设计,导致能耗高;二是预测边缘模糊,严重依赖后处理。脉冲神经网络(SNN)作为第三代神经网络,具备量化与脉冲驱动计算机制,天然具有低功耗优势,并能抑制纹理伪影,提升边缘清晰度。然而,量化误差会引入边缘稀疏不连续,制约清晰度提升。为此,我们提出首个面向边缘检测的SNN模型MS2Edge。核心是构建新型脉冲主干网络MS2ResNet,融合多尺度残差学习以恢复缺失边界线,生成清晰边缘;同时结合I-LIF神经元与膜基变形捷径(MDS)缓解量化误差。模型还配备脉冲多尺度上采样块(SMSUB)用于细节重建,以及膜平均解码(MAD)方法有效融合多时间步的边缘图。实验表明,MS2Edge在BSDS500、NYUDv2、BIPED、PLDU和PLDM数据集上均优于现有ANN方法,达到当前最优性能,且无需预训练主干网络,保持超低能耗,生成无需后处理的清晰边缘。
原文摘要 · Abstract (English)
Edge detection with Artificial Neural Networks (ANNs) has achieved remarkable prog\-ress but faces two major challenges. First, it requires pre-training on large-scale extra data and complex designs for prior knowledge, leading to high energy consumption. Second, the predicted edges perform poorly in crispness and heavily rely on post-processing. Spiking Neural Networks (SNNs), as third generation neural networks, feature quantization and spike-driven computation mechanisms. They inherently provide a strong prior for edge detection in an energy-efficient manner, while its quantization mechanism helps suppress texture artifact interference around true edges, improving prediction crispness. However, the resulting quantization error inevitably introduces sparse edge discontinuities, compromising further enhancement of crispness. To address these challenges, we propose MS2Edge, the first SNN-based model for edge detection. At its core, we build a novel spiking backbone named MS2ResNet that integrates multi-scale residual learning to recover missing boundary lines and generate crisp edges, while combining I-LIF neurons with Membrane-based Deformed Shortcut (MDS) to mitigate quantization errors. The model is complemented by a Spiking Multi-Scale Upsample Block (SMSUB) for detail reconstruction during upsampling and a Membrane Average Decoding (MAD) method for effective integration of edge maps across multiple time steps. Experimental results demonstrate that MS2Edge outperforms ANN-based methods and achieves state-of-the-art performance on the BSDS500, NYUDv2, BIPED, PLDU, and PLDM datasets without pre-trained backbones, while maintaining ultralow energy consumption and generating crisp edge maps without post-processing.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。