用脑电波识别驾驶风险,让机器人从人类反馈中学习。
Siamese Network with Dual Attention for EEG-Driven Social Learning: Bridging the Human-Robot Gap in Long-Tail Autonomous Driving
- 设计双注意力孪生网络提取脑电信号特征
- 数据稀缺下仍达80%分类准确率,特征有效性提升近100%
- 适合研究脑机接口与服务机器人社交学习的学者
具备轮式、四足或人形的机器人正日益融入建筑环境。然而,与人类社会学习不同,它们缺乏通过交互中的人类反馈实现内在认知发展的关键路径。为理解人类在动态不确定环境中普遍存在的观察、监督与共控行为,本研究提出一种脑机接口(BCI)框架,用于分类脑电图(EEG)信号以检测认知负荷高且安全关键的事件。作为一项及时且富有激励性的协同机器人工程应用,我们模拟了人机协同场景,标记半自动驾驶机器人驾驶中的高风险事件——代表长期难以解决的安全瓶颈问题。基于少样本学习的最新进展,我们提出一种结合动态时间弯曲平均法的双注意力孪生卷积网络,生成鲁棒的脑电编码信号表示。逆源定位显示布罗德曼4区和9区激活,表明任务相关心智意象中感知-动作耦合的存在。模型在数据稀缺条件下达到80%分类准确率,显著特征利用率相比现有方法提升近100%(通过集成梯度归因评估)。除性能外,本研究深化了对脑机接口代理所需认知架构的理解,特别是注意与记忆机制在区分多样心智状态及支持跨个体与个体内适应中的作用。总体而言,该研究推动了认知机器人与复杂建筑环境中服务机器人的社会引导学习发展。
原文摘要 · Abstract (English)
Robots with wheeled, quadrupedal, or humanoid forms are increasingly integrated into built environments. However, unlike human social learning, they lack a critical pathway for intrinsic cognitive development, namely, learning from human feedback during interaction. To understand human ubiquitous observation, supervision, and shared control in dynamic and uncertain environments, this study presents a brain-computer interface (BCI) framework that enables classification of Electroencephalogram (EEG) signals to detect cognitively demanding and safety-critical events. As a timely and motivating co-robotic engineering application, we simulate a human-in-the-loop scenario to flag risky events in semi-autonomous robotic driving-representative of long-tail cases that pose persistent bottlenecks to the safety performance of smart mobility systems and robotic vehicles. Drawing on recent advances in few-shot learning, we propose a dual-attention Siamese convolutional network paired with Dynamic Time Warping Barycenter Averaging approach to generate robust EEG-encoded signal representations. Inverse source localization reveals activation in Broadman areas 4 and 9, indicating perception-action coupling during task-relevant mental imagery. The model achieves 80% classification accuracy under data-scarce conditions and exhibits a nearly 100% increase in the utility of salient features compared to state-of-the-art methods, as measured through integrated gradient attribution. Beyond performance, this study contributes to our understanding of the cognitive architecture required for BCI agents-particularly the role of attention and memory mechanisms-in categorizing diverse mental states and supporting both inter- and intra-subject adaptation. Overall, this research advances the development of cognitive robotics and socially guided learning for service robots in complex built environments.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。