arXiv:2603.16897eess.SPcs.CL2026-03

用脑电波指导AI生成图像,让无法说话的人也能控制AI。

EEG-Based Brain-LLM Interface for Human Preference Aligned Generation

  • 通过脑电图信号判断用户满意度,实时反馈给AI模型
  • 实验表明脑电信号能准确预测用户偏好,正确率达78%
  • 适合肌萎缩侧索硬化等运动障碍人群使用

大型语言模型(LLMs)正成为人机交互的核心,用户可通过自然语言协调多种智能体。然而,语言接口依赖用户能稳定输出语言输入,这对言语或运动功能受损者(如肌萎缩侧索硬化症患者)不友好。本文探索神经信号作为替代输入的可能性,构建了一个简单的脑-语言模型接口:利用脑电图(EEG)信号在测试时引导图像生成模型。具体而言,先训练分类器从EEG中估计用户满意度,再将预测结果融入测试时缩放(TTS)框架,动态调整模型推理过程。实验表明,脑电图可有效预测用户满意度,说明神经活动蕴含实时偏好信息。这为将神经反馈引入自适应语言模型推理提供了初步基础,有望开启未来自适应大模型交互的新方向。

原文摘要 · Abstract (English)

Large language models (LLMs) are becoming an increasingly important component of human--computer interaction, enabling users to coordinate a wide range of intelligent agents through natural language. While language-based interfaces are powerful and flexible, they implicitly assume that users can reliably produce explicit linguistic input, an assumption that may not hold for users with speech or motor impairments, e.g., Amyotrophic Lateral Sclerosis (ALS). In this work, we investigate whether neural signals can be used as an alternative input to LLMs, particularly to support those socially marginalized or underserved users. We build a simple brain-LLM interface, which uses EEG signals to guide image generation models at test time. Specifically, we first train a classifier to estimate user satisfaction from EEG signals. Its predictions are then incorporated into a test-time scaling (TTS) framework that dynamically adapts model inference using neural feedback collected during user evaluation. The experiments show that EEG can predict user satisfaction, suggesting that neural activity carries information on real-time preference inference. These findings provide a first step toward integrating neural feedback into adaptive language-model inference, and hopefully open up new possibilities for future research on adaptive LLM interaction.

脑机接口情感计算生成模型无障碍技术

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。