arXiv:2502.12048cs.AIcs.HC2025-02综述被引 10

综述脑电到图像、文本、音频的生成技术,梳理方法与挑战。

A Survey on Bridging EEG Signals and Generative AI: From Image and Text to Beyond

  • 用生成模型将脑电信号转为图像/文本/音频,核心是编码解码架构。
  • 脑电转图像多用GAN/VAE/扩散模型,转文本倾向基于Transformer。
  • 适合脑机接口和神经科学研究者,助其快速了解技术进展。

将神经活动解码为人类可理解的表征是脑机接口与计算神经科学的关键方向。近年来,机器学习与生成式AI的发展推动了非侵入性脑电图(EEG)信号向图像、文本和音频转换的研究热潮。本文系统综述了脑电到图像合成、脑电到文本生成及脑电到音频重建的进展。通过2017至2025年主要数据库的结构化文献检索,提取了数据集、生成架构(如GAN、VAE、Transformer、扩散模型)、脑电特征编码方法、评估指标及当前主要挑战。研究发现,脑电到图像模型普遍采用基于GAN、VAE或扩散模型的编码器-解码器结构;脑电到文本方法越来越多依赖Transformer进行开放词汇解码;脑电到音频方法通常将脑电信号映射为梅尔频谱图,再通过神经声码器合成音频。尽管取得显著进展,该领域仍受限于小规模异构数据集、跨被试泛化能力差及缺乏标准化基准。本文整合方法趋势与可用数据集,为推进脑电驱动的生成式人工智能提供基础参考,并推荐开源数据集与基线实现,以促进系统化评测与研究可复现性。

原文摘要 · Abstract (English)

Decoding neural activity into human-interpretable representations is a key research direction in brain-computer interfaces (BCIs) and computational neuroscience. Recent progress in machine learning and generative AI has driven growing interest in transforming non-invasive Electroencephalography (EEG) signals into images, text, and audio. This survey consolidates and analyzes developments across EEG-to-image synthesis, EEG-to-text generation, and EEG-to-audio reconstruction. We conducted a structured literature search across major databases (2017-2025), extracting key information on datasets, generative architectures (GANs, VAEs, transformers, diffusion models), EEG feature-encoding techniques, evaluation metrics, and the major challenges shaping current work in this area. Our review finds that EEG-to-image models predominantly employ encoder-decoder architectures built on GANs, VAEs, or diffusion models; EEG-to-text approaches increasingly leverage transformer-based language models for open-vocabulary decoding; and EEG-to-audio methods commonly map EEG signals to mel-spectrograms that are subsequently rendered into audio using neural vocoders. Despite promising advances, the field remains constrained by small and heterogeneous datasets, limited cross-subject generalization, and the absence of standardized benchmarks. By consolidating methodological trends and available datasets, this survey provides a foundational reference for advancing EEG-based generative AI and supporting reproducible research. We further highlight open-source datasets and baseline implementations to facilitate systematic benchmarking and accelerate progress in EEG-driven neural decoding.

脑机接口生成模型脑电图神经解码

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。