arXiv:2608.19134cs.LG2026-08

无需标签即可跨用户实现脑电到图像的精准检索。

SCORE: Subject Coordinate Recovery for Label-Free Cross-Subject EEG-to-Image Retrieval

论文配图:SCORE: Subject Coordinate Recovery for Label-Free Cross-Subject EEG-to-Image Retrieval
图 1 · 摘自论文原文
  • 通过坐标对齐方法恢复不同用户的脑电信号表达方向。
  • 在两个数据集上达到53.23%和12.01%的Top-1准确率。
  • 适合需要快速部署、无标签校准的脑机接口应用。

准确的视觉解码能揭示大脑如何表征视觉信息,并从脑电信号(如EEG)中恢复感知内容,具有神经通信潜力。然而,现有脑电到图像检索方法在无标签校准的新用户上表现远低于同用户场景,限制了实际应用。我们分析跨被试的脑电特征,发现不同被试虽表达方向各异,但概念间关系相似。为此提出无需目标标签的框架SCORE,结合训练时的源域对齐与部署时的坐标恢复。训练阶段,将源被试脑电映射至统一图像空间,并通过仅用源数据的模拟任务增强泛化性。部署时,冻结编码器,利用去中心性匹配筛选可靠脑电-图像关键点,估计正交变换以恢复目标脑电坐标。在两个公开基准测试中,SCORE在200类检索任务上超越所有未适配基线,于THINGS-EEG2和Alljoined-1.6M分别取得53.23%/83.55%和12.01%/32.16%的Top-1/Top-5准确率,优于最强基线17.45/15.70和3.08/4.62个百分点。无需目标标签或编码器更新,使基于脑电的视觉解码更接近跨用户鲁棒、低延迟的实际部署。

原文摘要 · Abstract (English)

Accurate visual decoding can reveal how the brain represents visual information and recover perceived content from neural signals such as electroencephalography (EEG), with potential for neural communication. However, current EEG-to-image retrieval methods perform far below their within-subject counterparts for new users without labeled calibration, limiting real-world deployment. To understand this gap, we analyze EEG features across subjects and find that different subjects preserve similar relationships among concepts but express them along different coordinate directions. We therefore propose Subject Coordinate Recovery (SCORE), a target label-free framework combining recovery-aware source training with coordinate alignment at deployment. During training, SCORE aligns source subject EEG with a common image space and simulates unseen-subject recovery through source-only episodes. At deployment, with both encoders frozen, SCORE selects reliable EEG-image landmarks through hubness-corrected matching and estimates an orthogonal transformation to recover target EEG coordinates without source data or target labels. In 200-way retrieval on two public benchmarks, SCORE outperforms the unadapted baseline for every target subject and achieves the best overall accuracy. It reaches 53.23%/83.55% and 12.01%/32.16% Top-1/Top-5 on THINGS-EEG2 and Alljoined-1.6M, respectively, surpassing the strongest baselines by 17.45/15.70 and 3.08/4.62 percentage points. Without target labels or encoder updates, SCORE brings brain-based visual decoding closer to robust, practical, low-latency deployment across users.

脑机接口跨被试无监督图像检索

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。