提出自适应对齐方法,提升脑电视觉解码的鲁棒性
ProCA: Progressive Contrastive Alignment for Robust EEG Visual Decoding

- 分阶段动态调整语义监督,从固定视觉先验过渡到脑电信号感知的语义关系
- 在跨被试和持续学习场景下,准确率相对提升最高达28.1%(Top-1)
- 适合脑机接口、神经解码等需高鲁棒性的实时应用
脑电图(EEG)视觉解码旨在从非侵入性神经时间序列信号中恢复视觉语义,其核心在于噪声神经反应与稳定语义表征之间的鲁棒对齐。尽管对比学习取得进展,现有方法依赖固定视觉或文本锚点,其语义关系易与随实验、被试及训练阶段变化的脑电信号错位。实证表明该不稳定性存在于标准解码协议及更严苛的跨被试迁移与个性化持续适应场景中。我们证明固定语义监督会因脑电特异性关系演化而产生优化偏差,且结构无关扰动可能扭曲重要脑电成分。为此,我们提出渐进式对比对齐(ProCA),一种统一且模型无关的自适应神经-语义对齐框架。ProCA逐步将类别级对比监督从冻结的视觉-语言先验更新为脑电感知的语义关系,并引入结构一致插值,依据通道与时间重要性约束特征混合。在被试相关、被试无关、严格跨被试迁移及持续适应设置下,分别实现平均相对Top-1/Top-5提升7.4%/3.9%、10.0%/4.6%、28.1%/17.8%和16.8%/11.6%。
原文摘要 · Abstract (English)
Electroencephalogram (EEG) visual decoding aims to recover visual semantics from non-invasive neural time-series signals, for which robust alignment between noisy neural responses and stable semantic representations is key to achieving high-performance decoding. Despite recent advances in contrastive learning, robust EEG decoding remains challenging because existing methods rely on fixed visual or textual anchors whose semantic relations may become misaligned with EEG representations that vary across trials, subjects, and learning stages. Our empirical evidence shows that this instability appears across both standard EEG decoding protocols and more challenging robustness settings, including strict cross-subject transfer and realistic personalized continual adaptation. We provide a formal analysis showing that fixed semantic supervision can bias optimization when EEG-specific relations evolve, and that structure-agnostic perturbations may distort semantically important EEG components. To address these issues, we propose Progressive Contrastive Alignment (ProCA), a unified and model-agnostic framework for adaptive neural-semantic alignment. ProCA progressively refines class-level contrastive supervision from frozen vision-language priors to EEG-aware semantic relations, and introduces structure-consistent interpolation to constrain feature mixing according to channel-wise and temporal importance. Across subject-dependent, subject-independent, strict cross-subject transfer, and continual adaptation settings, ProCA achieves average relative Top-1/Top-5 gains of 7.4%/3.9%, 10.0%/4.6%, 28.1%/17.8%, and 16.8%/11.6%, respectively.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。