arXiv:2608.28967cs.ROcs.LG2026-08

用语言控制脑电信号,让少种类脑状态实现多样化机器人操作。

Brain-Language-Action (BLA) Models: Language-Conditioned EEG for Robotics Control

论文配图:Brain-Language-Action (BLA) Models: Language-Conditioned EEG for Robotics Control
图 1 · 摘自论文原文
  • 脑电信号通过语言条件动态映射到不同动作,扩展控制范围。
  • 在4种脑状态与7种飞行指令间实现90%的指令准确率。
  • 适合想提升脑机接口灵活性的研究者和开发者。

基于脑电图(EEG)的机器人控制通常被当作直接分类问题处理,将神经电信号映射到一组固定离散动作。然而,由于EEG信号可分性差且噪声高,该方法难以扩展至精细的机器人控制空间。本文提出脑-语言-动作(BLA)模型框架,通过语言条件化神经表征的解释来生成机器人动作。在BLA中,少量可区分的脑状态可通过语言定义的控制映射动态关联到不同动作,使少量神经类别适用于更大的全局动作空间。我们使用BCI竞赛IV 2a数据集中的运动想象型EEG开发了无人机控制的原型系统。系统分两阶段训练:首先评估多种候选EEG编码器架构,通过受试者特定的四类运动想象分类任务,将250Hz、3.5秒、22通道的EEG样本转换为五个128维的脑令牌嵌入;其次,这些嵌入被投影到预训练大语言模型(LLM)的嵌入空间,并与语言指令联合微调,以自回归方式生成结构化的三标记无人机动作。在840种可能的语言定义映射中,最终的BLA模型在评估中达到90%的每标记准确率。结果初步证明,语言条件化可扩大无需增加可区分神经状态数量的脑控机器人接口有效控制范围。

原文摘要 · Abstract (English)

Electroencephalography (EEG)-based robotic control is commonly formulated as a direct classification problem, in which electrical neural signals are mapped to a fixed set of discrete actions. However, the limited separability and high noise of EEG signals make it difficult to scale this approach to fine-grained robotic control spaces. We introduce Brain-Language-Action (BLA) models, a framework in which language conditions the interpretation of neural representations for robotic action generation. In a BLA, a small set of reliably distinguishable brain states can be dynamically associated with different actions through a language-defined control mapping, allowing a small number of neural classes to apply to a larger global action space. We develop a proof-of-concept BLA for drone control using motor-imagery EEG from the BCI Competition IV 2a dataset. The system is trained in two stages. First, we evaluate multiple candidate EEG encoder architectures using subject-specific four-class motor-imagery classification, converting 250Hz, 3.5-second, 22-channel EEG samples into five 128-dimensional brain-token embeddings. Second, these embeddings are projected into the embedding space of a pretrained large language model (LLM) and jointly fine-tuned with language instructions to autoregressively generate structured three-token drone actions. Across 840 possible language-defined mappings between four neural states and seven flight action combinations, the resulting BLA achieves 90% per-token accuracy during evaluation. These results provide an initial demonstration that language conditioning can expand the effective control range of EEG-based robotic interfaces without requiring a corresponding increase in the number of directly distinguishable neural states.

脑机接口语言模型无人机控制

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。