用脉冲神经网络实现遥感模型的低功耗在线自适应,快速应对环境变化。
Brain-Inspired Online Adaptation for Remote Sensing with Spiking Neural Network
- 基于脉冲神经网络设计无监督在线学习算法,仅正向传播降低计算开销。
- 在七大数据集上验证,对天气变化等干扰适应能力显著优于现有方法。
- 适合部署在卫星、无人机等算力受限的边缘设备,支持实时感知更新。
面向在轨卫星和无人机等边缘设备的遥感任务,本工作提出一种基于脉冲神经网络(SNN)的在线自适应框架。针对边缘计算中高能效与快速适应的双重需求,设计了一种高效无监督的在线学习算法,采用近似梯度反向传播(BPTT)的前向计算机制,大幅降低SNN适应学习的复杂度。同时引入自适应激活缩放方案,在短时间步下提升适应性能;针对更具挑战性的遥感检测任务,提出置信度加权实例策略,显著改善适应效果。实验在七个基准数据集上覆盖分类、分割与检测任务,结果表明该方法在不同天气条件下均显著优于现有域适应与域泛化方法。所提方法实现了边缘设备上的低功耗、快速在线适应,具有在轨遥感感知等场景的重要应用潜力。
原文摘要 · Abstract (English)
On-device computing, or edge computing, is becoming increasingly important for remote sensing, particularly in applications like deep network-based perception on on-orbit satellites and unmanned aerial vehicles (UAVs). In these scenarios, two brain-like capabilities are crucial for remote sensing models: (1) high energy efficiency, allowing the model to operate on edge devices with limited computing resources, and (2) online adaptation, enabling the model to quickly adapt to environmental variations, weather changes, and sensor drift. This work addresses these needs by proposing an online adaptation framework based on spiking neural networks (SNNs) for remote sensing. Starting with a pretrained SNN model, we design an efficient, unsupervised online adaptation algorithm, which adopts an approximation of the BPTT algorithm and only involves forward-in-time computation that significantly reduces the computational complexity of SNN adaptation learning. Besides, we propose an adaptive activation scaling scheme to boost online SNN adaptation performance, particularly in low time-steps. Furthermore, for the more challenging remote sensing detection task, we propose a confidence-based instance weighting scheme, which substantially improves adaptation performance in the detection task. To our knowledge, this work is the first to address the online adaptation of SNNs. Extensive experiments on seven benchmark datasets across classification, segmentation, and detection tasks demonstrate that our proposed method significantly outperforms existing domain adaptation and domain generalization approaches under varying weather conditions. The proposed method enables energy-efficient and fast online adaptation on edge devices, and has much potential in applications such as remote perception on on-orbit satellites and UAV.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。