用轻量头提升脉冲网络的分布外检测能力,避免预测趋同。
Breaking Diversity Collapse in Spiking Pseudo-Ensembles for Efficient OOD Detection in Remote Sensing

- 在冻结的脉冲骨干上加多个轻量分类头,形成伪集成。
- 引入同意-分歧目标,使头间预测更分散,提升不确定性判断。
- 比五模型深度集成少38%参数、40%推理量,适合遥感边缘设备。
脉冲神经网络(SNN)适用于资源受限的遥感系统,但可靠的分布外(OOD)检测仍具挑战。深度集成虽能提供强预测不确定性,但需多套完整模型和多次主干计算。本文提出一种高效的脉冲伪集成方法,在冻结的SNN主干上附加多个轻量分类头。直接使用交叉熵训练会导致多样性崩溃,即独立参数的头产生相关预测。为此,我们引入一个同意-分歧目标,在保持对干净分布样本正确预测的同时,鼓励对同一输入的结构化扰动产生差异性输出,从而在无需外部OOD数据的情况下促进多样性。在EuroSAT上使用Spikformer和ResNet19-SNN的实验表明,该方法持续优于传统训练的伪集成。采用三个主干各配五个头,在UCM和AID上达到或超过五模型深度集成性能,同时减少约38%参数量和40%主干评估次数。结果表明,显式促进多样性可大幅降低部署成本,仍保留类集成的不确定性表达能力。
原文摘要 · Abstract (English)
Spiking Neural Networks (SNNs) are attractive for resource-constrained remote-sensing systems, but reliable out-of-distribution (OOD) detection remains challenging. Deep ensembles provide strong predictive uncertainty, yet require multiple complete models and backbone evaluations. We propose an efficient spiking pseudo-ensemble that attaches multiple lightweight classification heads to a frozen SNN backbone. Naively training these heads with cross-entropy can lead to diversity collapse, where independently parameterized heads may produce correlated predictions. To address this, we introduce an agree--disagree objective that preserves correct predictions on clean in-distribution samples while encouraging diversity on structured, uncertainty-inducing transformations of the same inputs. This provides a diversity-promoting training signal without requiring external OOD data. Experiments with Spikformer and ResNet19-SNN on EuroSAT demonstrate consistent improvements over conventionally trained pseudo-ensembles. Using three backbones with five heads each matches or improves upon a five-model deep ensemble on UCM and AID, while requiring approximately 38% fewer parameters and 40% fewer backbone evaluations. These results show that explicit diversity promotion can recover useful ensemble-style uncertainty at substantially lower deployment cost.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。