通过用户看与不看的模式,用眼动数据预测性格五因素。
Characterizing Personality from Eye-Tracking: The Role of Gaze and Its Absence in Interactive Search Environments
- 结合眼动轨迹和视线缺失时段,构建多模态时间序列模型。
- 五维度性格预测的宏平均F1达73%~78%,显著优于传统方法。
- 视线缺失本身是重要信号,纳入后性能提升10%-15%。
人格特质影响个体在信息搜索过程中的行为与决策方式,但极少研究将人格与可观察的搜索行为关联。本研究提出一种融合眼动数据与视线缺失时段的多模态时间序列模型,以刻画人格特征。研究基于一个核心假设:人们思考时常会移开视线,这可能反映脱离或反思状态。我们招募25名参与者,在iPad上使用交互式博物馆数字应用进行实验,采集原始眼动数据,最大限度减少预处理,保留真实行为模式。利用这些数据训练模型预测大五人格特质。五折交叉验证结果显示,各维度预测表现良好:神经质(宏平均F1=77.69%)、尽责性(74.52%)、开放性(77.52%)、宜人性(73.09%)、外向性(76.69%)。消融实验表明,引入视线缺失信息能显著提升模型性能。整合时间序列信号与缺失信息的完整模型,在所有大五特质上相比仅依赖时间序列或缺失信息的模型,准确率与宏平均F1提升10%-15%。结果表明,可通过搜索过程中的眼动行为推断人格,并证明在时间序列多模态建模中纳入缺失数据具有关键价值。
原文摘要 · Abstract (English)
Personality traits influence how individuals engage, behave, and make decisions during the information-seeking process. However, few studies have linked personality to observable search behaviors. This study aims to characterize personality traits through a multimodal time-series model that integrates eye-tracking data and gaze missingness-periods when the user's gaze is not captured. This approach is based on the idea that people often look away when they think, signaling disengagement or reflection. We conducted a user study with 25 participants, who used an interactive application on an iPad, allowing them to engage with digital artifacts from a museum. We rely on raw gaze data from an eye tracker, minimizing preprocessing so that behavioral patterns can be preserved without substantial data cleaning. From this perspective, we trained models to predict personality traits using gaze signals. Our results from a five-fold cross-validation study demonstrate strong predictive performance across all five dimensions: Neuroticism (Macro F1 = 77.69%), Conscientiousness (74.52%), Openness (77.52%), Agreeableness (73.09%), and Extraversion (76.69%). The ablation study examines whether the absence of gaze information affects the model performance, demonstrating that incorporating missingness improves multimodal time-series modeling. The full model, which integrates both time-series signals and missingness information, achieves 10-15% higher accuracy and macro F1 scores across all Big Five traits compared to the model without time-series signals and missingness. These findings provide evidence that personality can be inferred from search-related gaze behavior and demonstrate the value of incorporating missing gaze data into time-series multimodal modeling.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。