arXiv:2607.15395cs.RO2026-07中稿 · the 2026 IEEE/RSJ …

用脑电肌电眼动信号预测执行意愿,实现安全辅助操作的智能决策。

NeuroCommitSSM: Decision-Centric Shared Autonomy for Safe Assistive Manipulation via EEG-EMG-ET Commit Readiness

论文配图:NeuroCommitSSM: Decision-Centric Shared Autonomy for Safe Assistive Manipulation via EEG-EMG-ET Commit Readiness
图 1 · 摘自论文原文
  • 融合脑电、肌电和眼动信号,连续输出执行准备度得分
  • 在32人测试中准确率达0.950,误触发仅0.75次/1000静息窗口
  • 支持传感器缺失场景,适合残障人士的康复机器人应用

我们提出NeuroCommitSSM,一种以决策为中心的框架,重点解决何时执行而非做什么的问题,实现辅助机器人操作的安全执行。该框架通过同步采集脑电(EEG)、肌电(EMG)和眼动(ET)信号,连续预测执行准备度得分c_t∈[0,1],并经滞留与滞后滤波转换为离散执行事件。一个三状态有限状态机HOLD-ASSIST-COMMIT(HAC)在启动动作前,要求神经模型提供持续的执行准备信号,并结合实时感知与机器人状态可行性(包括目标可见性、逆运动学可解性及无碰撞路径规划)。我们在N=32名受试者上评估了五项日常生活活动任务(符合国际功能、残疾与健康分类标准),采用留一被试交叉验证和七种传感器丢失情景(S0-S6)。NeuroCommitSSM在动作平衡准确率上达0.950,误触发为0.75次/1000静息窗口(FP/1k REST),在传感器缺失下仍保持低误触发与稳定状态切换。例如,在仅使用脑电条件下,其平衡准确率为0.785,误触发为0.29 FP/1k REST;而时间卷积网络基线在相同条件下产生99.95 FP/1k REST。硬件在环(HIL)实验在Kinova Gen3机械臂上验证,可行性检查后的执行显著减少误启动与决策波动,且不牺牲任务成功率。补充材料(代码、数据集、视频及分析)见https://madibabaiasl.github.io/NeuroCommitSSM/

原文摘要 · Abstract (English)

We present NeuroCommitSSM, a decision-centric framework that models when to execute, not just what to do, for safe commit-to-execute control in assistive robotic manipulation. NeuroCommitSSM predicts a continuous commit-readiness score c_t in [0,1] from synchronized electroencephalography (EEG), electromyography (EMG), and eye-tracking (ET), and converts it into discrete commit events through dwell and hysteresis filtering. A three-state finite-state supervisor, HOLD-ASSIST-COMMIT (HAC), gates execution by requiring both a sustained commit-readiness signal from the neural model and real-time perception and robot-state feasibility, including target visibility, inverse kinematics solvability, and collision-free planning, before initiating motion. We evaluate the framework on N=32 subjects performing five activities of daily living (ADL) tasks aligned with the International Classification of Functioning, Disability and Health (ICF), using leave-one-subject-out (LOSO) cross-validation and seven sensor-dropout scenarios (S0-S6). NeuroCommitSSM achieves 0.950 action-balanced accuracy with 0.75 false commit events per 1000 REST windows (FP/1k REST), and maintains low false commits and stable state transitions under sensor loss. For example, in the EEG-only condition, it achieves 0.785 balanced accuracy and 0.29 FP/1k REST, whereas the Temporal Convolutional Network baseline produces 99.95 FP/1k REST under the same condition. Hardware-in-the-loop (HIL) validation on a Kinova Gen3 arm shows that feasibility-checked execution reduces false starts and decision instability without sacrificing task success. Supplementary materials, including code, datasets, videos, and additional analyses, are available at https://madibabaiasl.github.io/NeuroCommitSSM/.

脑机接口辅助机器人多模态融合安全决策

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。