用脑电与眼动数据实时识别阅读困惑,提升学习系统适应性。
Detecting Reading-Induced Confusion Using EEG and Eye Tracking
- 融合脑电与眼动数据,识别阅读时的语义冲突
- 多模态模型准确率达77.3%(最高89.6%),比单一模态提升4-22%
- 为可穿戴脑机接口与个性化学习系统提供新思路
人类在阅读文章、浏览社交媒体或与聊天机器人交互时,常因信息过载或与已有知识冲突而产生困惑,影响学习效果。本研究通过脑电(EEG)与眼动追踪技术,对11名成年参与者在自然阅读场景中的神经与行为反应进行多模态分析。通过分离已知的语义不一致神经标志物N400,并结合眼动行为特征,揭示了阅读困惑的神经与行为关联。基于机器学习,多模态模型相较单模态基线分类准确率提升4-22%,平均加权参与者准确率达77.3%,最佳个体准确率达89.6%。结果表明,大脑颞叶区域在困惑信号中起主导作用,为开发低电极数、可穿戴式脑机接口以实现实时困惑监测提供了可能。研究为构建能动态感知并响应用户困惑的自适应系统奠定基础,适用于个性化学习、人机交互与无障碍设计。
原文摘要 · Abstract (English)
Humans regularly navigate an overwhelming amount of information via text media, whether reading articles, browsing social media, or interacting with chatbots. Confusion naturally arises when new information conflicts with or exceeds a reader's comprehension or prior knowledge, posing a challenge for learning. In this study, we present a multimodal investigation of reading-induced confusion using EEG and eye tracking. We collected neural and gaze data from 11 adult participants as they read short paragraphs sampled from diverse, real-world sources. By isolating the N400 event-related potential (ERP), a well-established neural marker of semantic incongruence, and integrating behavioral markers from eye tracking, we provide a detailed analysis of the neural and behavioral correlates of confusion during naturalistic reading. Using machine learning, we show that multimodal (EEG + eye tracking) models improve classification accuracy by 4-22% over unimodal baselines, reaching an average weighted participant accuracy of 77.3% and a best accuracy of 89.6%. Our results highlight the dominance of the brain's temporal regions in these neural signatures of confusion, suggesting avenues for wearable, low-electrode brain-computer interfaces (BCI) for real-time monitoring. These findings lay the foundation for developing adaptive systems that dynamically detect and respond to user confusion, with potential applications in personalized learning, human-computer interaction, and accessibility.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。