提出BRAIN方法,缓解脑信号随时间变化导致的视觉理解偏差问题。
BRAIN: Bias-Mitigation Continual Learning Approach to Vision-Brain Understanding
- 采用持续学习框架,动态修正脑信号中的偏移与不一致性。
- 在多个基准上实现当前最优性能,显著优于传统方法。
- 适合研究脑机接口、神经信号建模与持续学习的学者参考。
记忆衰退使人类大脑难以识别视觉物体并保留细节,导致记录的脑信号随时间减弱、不确定且视觉上下文信息贫乏。本文首次提出一种面向视觉-脑理解(VBU)的持续学习方法来应对该问题。首先,我们通过统计和实验验证了脑信号中存在不一致现象及其对模型的影响:脑信号表征在不同记录会话中发生漂移,导致偏见累积,阻碍模型学习并降低性能。为此,我们提出新的偏差缓解持续学习方法(BRAIN),在持续学习框架下逐步消除每一步学习产生的偏差。新提出的去偏对比学习损失函数有效缓解了偏见问题;同时引入基于角度的遗忘抑制机制,防止模型在更新时丢失先前知识。实验证明,该方法在多个基准上达到当前最优(SOTA)表现,超越了以往及非持续学习方法。
原文摘要 · Abstract (English)
Memory decay makes it harder for the human brain to recognize visual objects and retain details. Consequently, recorded brain signals become weaker, uncertain, and contain poor visual context over time. This paper presents one of the first vision-learning approaches to address this problem. First, we statistically and experimentally demonstrate the existence of inconsistency in brain signals and its impact on the Vision-Brain Understanding (VBU) model. Our findings show that brain signal representations shift over recording sessions, leading to compounding bias, which poses challenges for model learning and degrades performance. Then, we propose a new Bias-Mitigation Continual Learning (BRAIN) approach to address these limitations. In this approach, the model is trained in a continual learning setup and mitigates the growing bias from each learning step. A new loss function named De-bias Contrastive Learning is also introduced to address the bias problem. In addition, to prevent catastrophic forgetting, where the model loses knowledge from previous sessions, the new Angular-based Forgetting Mitigation approach is introduced to preserve learned knowledge in the model. Finally, the empirical experiments demonstrate that our approach achieves State-of-the-Art (SOTA) performance across various benchmarks, surpassing prior and non-continual learning methods.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。