模仿生物神经网络遗忘机制,提升高光谱异常检测的持续学习能力。
CL-BioGAN: Biologically-Inspired Cross-Domain Continual Learning for Hyperspectral Anomaly Detection
- 基于生物启发的损失函数与自注意力生成对抗网络,实现旧知识主动遗忘。
- 在跨域检测中准确率更高,参数和计算开销更少。
- 适合需要长期适应新场景的高光谱异常检测任务。
持续学习中的记忆稳定性与学习灵活性是跨场景高光谱异常检测(HAD)的核心挑战。生物神经网络可通过调控学习触发的突触扩张与收敛,主动遗忘与新经验冲突的历史知识。受此启发,本文提出一种生物启发式持续学习生成对抗网络(CL-BioGAN),用于增强跨域HAD任务的连续分布拟合能力。通过引入持续学习生物启发损失(CL-Bio Loss)与自注意力生成对抗网络(BioGAN),实现历史知识遗忘并结合回放策略。具体地,设计了一种由主动遗忘损失(AF Loss)与持续学习损失组成的新型生物启发损失,从贝叶斯视角实现新旧任务间的参数释放与增强。同时,结合L2范数的BioGAN损失强化自注意力机制,进一步平衡稳定性与灵活性,提升开放场景下背景分布的拟合效果。实验结果表明,所提方法在跨域HAD任务中具有更优的鲁棒性与精度,且参数量与计算成本更低。该工作不仅提升了持续学习性能,也为开放场景下的神经适应机制提供了新见解。
原文摘要 · Abstract (English)
Memory stability and learning flexibility in continual learning (CL) is a core challenge for cross-scene Hyperspectral Anomaly Detection (HAD) task. Biological neural networks can actively forget history knowledge that conflicts with the learning of new experiences by regulating learning-triggered synaptic expansion and synaptic convergence. Inspired by this phenomenon, we propose a novel Biologically-Inspired Continual Learning Generative Adversarial Network (CL-BioGAN) for augmenting continuous distribution fitting ability for cross-domain HAD task, where Continual Learning Bio-inspired Loss (CL-Bio Loss) and self-attention Generative Adversarial Network (BioGAN) are incorporated to realize forgetting history knowledge as well as involving replay strategy in the proposed BioGAN. Specifically, a novel Bio-Inspired Loss composed with an Active Forgetting Loss (AF Loss) and a CL loss is designed to realize parameters releasing and enhancing between new task and history tasks from a Bayesian perspective. Meanwhile, BioGAN loss with L2-Norm enhances self-attention (SA) to further balance the stability and flexibility for better fitting background distribution for open scenario HAD (OHAD) tasks. Experiment results underscore that the proposed CL-BioGAN can achieve more robust and satisfying accuracy for cross-domain HAD with fewer parameters and computation cost. This dual contribution not only elevates CL performance but also offers new insights into neural adaptation mechanisms in OHAD task.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。