arXiv:2602.10361q-bio.NCcs.AI2026-02

用不到1%参数量,15分钟就能让新用户实现高精度脑电图像重建。

ENIGMA: EEG-to-Image in 15 Minutes Using Less Than 1% of the Parameters

  • 采用统一时空骨干+多主体隐空间对齐,轻量架构直接从脑电信号还原图像。
  • 在科研与消费级设备上均达当前最优性能,新用户仅需15分钟数据微调。
  • 首次开展人类评分评估,适合追求高效部署的BCI应用开发者。

为实现脑机接口在真实场景中的实用化,模型需具备易部署、低成本硬件兼容及本地运行能力。为此,我们提出ENIGMA——一种多被试脑电(EEG)到图像解码模型,能从脑电信号重建视觉图像,在研究级THINGS-EEG2与消费级AllJoined-1.6M基准上达到当前最优(SOTA)表现,且仅需15分钟新被试数据即可有效微调。该模型参数量不足此前方法的1%,结构更简单。其核心由统一时空骨干、多被试隐空间对齐层及MLP投影器组成,将原始脑电信号映射至丰富的视觉隐空间。我们采用标准化图像重建指标评估,并首次在脑电到图像研究中引入人类评分的全面行为评估。结果表明,该模型在科研与消费级设备上均显著提升性能,同时大幅降低微调效率与推理成本。通过系统消融实验,我们验证了各模块对单/多被试场景下性能提升的关键作用。本工作为实用化脑机接口应用迈出关键一步。

原文摘要 · Abstract (English)

To be practical for real-life applications, models for brain-computer interfaces must be easily and quickly deployable on new subjects, effective on affordable scanning hardware, and small enough to run locally on accessible computing resources. To directly address these current limitations, we introduce ENIGMA, a multi-subject electroencephalography (EEG)-to-Image decoding model that reconstructs seen images from EEG recordings and achieves state-of-the-art (SOTA) performance on the research-grade THINGS-EEG2 and consumer-grade AllJoined-1.6M benchmarks, while fine-tuning effectively on new subjects with as little as 15 minutes of data. ENIGMA boasts a simpler architecture and requires less than 1% of the trainable parameters necessary for previous approaches. Our approach integrates a subject-unified spatio-temporal backbone along with a set of multi-subject latent alignment layers and an MLP projector to map raw EEG signals to a rich visual latent space. We evaluate our approach using a broad suite of image reconstruction metrics that have been standardized in the adjacent field of fMRI-to-Image research, and we describe the first EEG-to-Image study to conduct extensive behavioral evaluations of our reconstructions using human raters. Our simple and robust architecture provides a significant performance boost across both research-grade and consumer-grade EEG hardware, and a substantial improvement in fine-tuning efficiency and inference cost. Finally, we provide extensive ablations to determine the architectural choices most responsible for our performance gains in both single and multi-subject cases across multiple benchmark datasets. Collectively, our work provides a substantial step towards the development of practical brain-computer interface applications.

脑机接口图像重建轻量化模型快速微调

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。