arXiv:2605.16418cs.CVcs.AI2026-05

通过认知引导的模糊与信息约束对齐,提升脑电视觉解码精度。

Neural Visual Decoding via Cognitive guided Adaptive Blurring and Information Constrained Alignment

论文配图:Neural Visual Decoding via Cognitive guided Adaptive Blurring and Information Constrained Alignment
图 1 · 摘自论文原文
  • 用动态视觉模糊模拟注意力机制,减少冗余信息。
  • 在零样本图像检索中,Top-1和Top-5准确率显著优于现有方法。
  • 适合关注脑机接口、神经信号解码的研究者。

基于脑电的视觉解码旨在建立神经信号与视觉语义之间的映射关系。然而,该任务受限于严重的信息粒度不匹配和脑电信号信噪比低的问题。现有方法通常采用静态视觉特征,忽略了人类视觉的动态选择性及神经振荡的频率特异性。为此,我们提出CAIA框架——一种认知引导的自适应模糊与信息约束对齐方法。在视觉侧,通过跨模态注意力动态融合中心偏置与显著性引导的视觉线索,实现选择性注意力模拟;在脑电侧,利用神经振荡先验与信息瓶颈机制提升信噪比。进一步引入分布感知边界校准损失,有效缓解异常样本导致的对齐偏差。同时,提出认知引导的信息筛选方法,选取任务相关的脑电振荡成分。大量实验表明,CAIA在零样本脑电到图像检索任务中,显著提升了个体内与跨个体的Top-1与Top-5平均准确率,验证了优化视觉信息密度以匹配神经粒度的可行性与鲁棒性。

原文摘要 · Abstract (English)

EEG-based visual decoding aims to establish a mapping between neural signals and visual semantics. However, it remains constrained by the dual challenges of severe information granularity mismatch and the low signal-to-noise ratio (SNR) of EEG signals. Existing approaches typically treat static visual features, ignoring the dynamic selectivity of human vision and the frequency specificity of neural oscillations. To bridge this gap, we propose CAIA, a Cognitive-guided Adaptive blurring with Information-Constrained Alignment framework for Neural-Visual decoding. On the visual side, it simulates selective attention to adaptively reduce redundancy. Meanwhile, on the EEG side, it leverages neural oscillation priors and the information bottleneck mechanism to enhance SNR. Specifically, we devise a cognitive-dynamics-based adaptive blurring mechanism that dynamically integrates center-biased and saliency-guided visual cues via cross-modal attention. Furthermore, we introduce a distribution-aware boundary calibration loss to robustly rectify alignment bias caused by outlier samples. Moreover, a cognitively-guided information-screening method is proposed to select task-relevant EEG oscillations. Extensive experiments demonstrate that CAIA improves both subject-dependent and subject-independent average Top-1 and Top-5 accuracy in zero-shot brain-to-image retrieval, significantly outperforming prior methods. Our work validates that optimizing visual information density to match neural granularity offers a more interpretable and robust pathway for neural decoding.

脑电解码视觉生成认知模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。