arXiv:2412.12801cs.CVcs.LG2024-12被引 5

模拟大脑动态融合多视角数据,提升增量学习泛化能力。

Multi-View Incremental Learning with Structured Hebbian Plasticity for Enhanced Fusion Efficiency

  • 用结构化赫布可塑性建模视图间关联,实现细粒度特征融合。
  • 在六大数据集上超越现有方法,保持旧知识且避免权重剧烈波动。
  • 适合需要持续学习多源视觉信息的场景,如智能监控、自动驾驶。

多媒体技术的快速发展推动了多视角学习的发展。然而,传统多视角学习方法适用于固定视图场景,难以模拟人脑处理信号的序列化认知过程。人脑通过复杂的前馈与反馈机制实现数据的无缝整合,而传统方法在面对跨域数据时泛化能力不足,亟需能模仿大脑适应性与动态整合能力的新策略。本文提出一种生物神经启发的多视角增量学习框架MVIL,包含结构化赫布可塑性与突触分块学习两个核心模块。前者通过重塑权重结构表达视图表示间的高相关性,实现细粒度融合;后者通过抑制部分突触,有效缓解权重剧变并保留旧知识。二者协同强化新旧知识间的关联,显著提升模型泛化能力。在六个基准数据集上的实验表明,MVIL在性能上优于当前最优方法。

原文摘要 · Abstract (English)

The rapid evolution of multimedia technology has revolutionized human perception, paving the way for multi-view learning. However, traditional multi-view learning approaches are tailored for scenarios with fixed data views, falling short of emulating the intricate cognitive procedures of the human brain processing signals sequentially. Our cerebral architecture seamlessly integrates sequential data through intricate feed-forward and feedback mechanisms. In stark contrast, traditional methods struggle to generalize effectively when confronted with data spanning diverse domains, highlighting the need for innovative strategies that can mimic the brain's adaptability and dynamic integration capabilities. In this paper, we propose a bio-neurologically inspired multi-view incremental framework named MVIL aimed at emulating the brain's fine-grained fusion of sequentially arriving views. MVIL lies two fundamental modules: structured Hebbian plasticity and synaptic partition learning. The structured Hebbian plasticity reshapes the structure of weights to express the high correlation between view representations, facilitating a fine-grained fusion of view representations. Moreover, synaptic partition learning is efficient in alleviating drastic changes in weights and also retaining old knowledge by inhibiting partial synapses. These modules bionically play a central role in reinforcing crucial associations between newly acquired information and existing knowledge repositories, thereby enhancing the network's capacity for generalization. Experimental results on six benchmark datasets show MVIL's effectiveness over state-of-the-art methods.

多视角学习增量学习神经启发特征融合

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。