用眼动数据实时识别读者是查信息还是读理解,准确率高。
Decoding Reading Goals from Eye Movements
- 用扫描路径和语言模型构建注意力机制,识别阅读目标
- 模型在读完前就可准确预测,实时性好
- 适合研究阅读行为或人机交互的学者
读者在阅读时可能有不同的目标。本研究首次探讨能否通过眼动数据区分两种常见阅读目标:信息搜索与普通理解阅读。基于大规模眼动追踪数据,我们测试了多种模型架构与表示方法,并提出一种新模型集成方法。结果显示,基于Transformer的扫描路径模型结合语言建模效果最佳,可在读者完成阅读前实现高精度实时预测。此外,我们引入基于混合效应模型的新分析方法,结合丰富文本标注,揭示影响任务难度的关键文本特征与读者因素,深化了对两类阅读模式下眼动差异的理解。
原文摘要 · Abstract (English)
Readers can have different goals with respect to the text that they are reading. Can these goals be decoded from their eye movements over the text? In this work, we examine for the first time whether it is possible to distinguish between two types of common reading goals: information seeking and ordinary reading for comprehension. Using large-scale eye tracking data, we address this task with a wide range of models that cover different architectural and data representation strategies, and further introduce a new model ensemble. We find that transformer-based models with scanpath representations coupled with language modeling solve it most successfully, and that accurate predictions can be made in real time, long before the participant finished reading the text. We further introduce a new method for model performance analysis based on mixed effect modeling. Combining this method with rich textual annotations reveals key properties of textual items and participants that contribute to the difficulty of the task, and improves our understanding of the variability in eye movement patterns across the two reading regimes.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。