用结构化亲和力实现无需重放的视觉增量学习记忆
Structured Affinity for Unsupervised Visual Class-Incremental Memory in Deep Artificial Immune Networks
- 将视觉B细胞建模为带空间结构的模板,用零归一化互相关等方法捕捉特征图关联
- 在不依赖回放、标签或反向传播下,对10类数字数据达到0.939平衡准确率
- 适合关注无监督增量学习、免疫启发模型的研究者
人工免疫网络(AINs)天然具备记忆能力,但传统视觉AINs多采用扁平向量亲和力,忽略空间结构。本文研究结构化、无梯度的免疫亲和力能否使深度AINs成为免重放的视觉类增量表示-记忆学习器。将视觉B细胞形式化为结构化模板,包括位移模板亲和力、零归一化互相关(ZNCC)滤波器和特征图绑定轮廓。谱库既作为记忆,也作为表征生成基础,通过传递绑定轮廓响应图实现深度扩展。结果表明,深度AIN可实现自适应潜在坐标重组:新类到来时,绑定轮廓空间动态演化,同时保留早期类别的可恢复结构。在sklearn digits、MNIST、Fashion-MNIST和KMNIST上实验显示,保持响应图至关重要;标量绑定轮廓变体性能较差,而特征图型深度AIN在无重放、无标签驱动更新、无免疫层反向传播的情况下,学习到类判别性视觉记忆。在sklearn digits上,下游探针在全部十类学习完成后,逻辑回归达0.939平衡准确率,1-最近邻达0.902,初始类保留率达0.978。自适应逐层尺度校准进一步提升双层特征图深度AIN至0.978平衡准确率;相同规则下,Fashion-MNIST达0.814,KMNIST达0.853。这些探针为外部验证工具,非AIN组成部分。结果揭示结构化亲和力、响应图保存、自适应潜在重组及逐层尺度校准是免重放视觉免疫记忆的关键机制。
原文摘要 · Abstract (English)
Artificial immune networks (AINs) are naturally memory-forming systems, but conventional visual AINs often rely on flattened vector affinity that ignores spatial structure. This paper studies whether structured, gradient-free immune affinity can make Deep AINs viable as replay-free visual class-incremental representation-memory learners. Visual B-cells are formalized as structured templates, including shifted-template affinity, zero-normalized cross-correlation (ZNCC) filters, and feature-map binding profiles. A repertoire is treated both as memory and as a representation-inducing basis, while depth is obtained by passing binding-profile response maps to subsequent immune layers. The resulting Deep AIN exhibits adaptive latent coordinate reorganization: as new classes arrive, the binding-profile space evolves while retaining recoverable structure for earlier classes. Experiments on sklearn digits, MNIST, Fashion-MNIST, and KMNIST show that preserving response maps is critical. Scalar binding-profile variants underperform, whereas feature-map Deep AINs learn class-discriminative visual memory without replay, label-driven immune updates, or backpropagation through the immune layers. On sklearn digits, downstream probes fitted on the learned binding profiles reach 0.939 final balanced accuracy with logistic regression and 0.902 with 1-nearest-neighbour after all ten classes are encountered, with initial-class retention of 0.978. Adaptive layer-wise scale calibration further improves the two-layer feature-map Deep AIN to 0.978 balanced accuracy. With the same calibration rule, Fashion-MNIST reaches 0.814 and KMNIST reaches 0.853. These probes are external validation tools, not components of the AIN. The results identify structured affinity, response-map preservation, adaptive latent reorganization, and layer-wise scale calibration as key mechanisms for replay-free visual immune memory.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。