arXiv:2409.06898cs.HCcs.LG2024-09被引 21

首个真实行走中记录多维度数据的VR晕动症数据集

Mazed and Confused: A Dataset of Cybersickness, Working Memory, Mental Load, Physical Load, and Attention During a Real Walking Task in VR

  • 采集39人行走时的头部位置、眼动、生理信号等数据
  • 实现95%准确率的晕动症严重程度分类
  • 适合研究VR体验优化与认知负荷管理的开发者

虚拟现实(VR)正快速应用于培训、教育、医疗和娱乐等领域,用户常需同时完成复杂的认知与身体活动。然而,认知活动、身体活动与晕动症之间的关系尚不明确,对开发者而言难以预测。现有研究多基于静止状态下的晕动症标注数据集,缺乏真实行走场景的数据。本研究从39名参与者中收集了头部位姿、眼动追踪、图像、外部传感器生理信号,以及用户自评的晕动症严重度、身体负荷和心理负荷数据。实验中,参与者通过真实行走穿越迷宫,并完成挑战注意力与工作记忆的任务。为验证数据集价值,我们进行了分类器训练,实现了95%的晕动症严重度分类准确率。简单分类器表现优异,表明该数据集适合用于开发晕动症检测与缓解模型。通过SHAP分析发现,眼动和生理指标在行走时的晕动症预测中尤为重要。该开放数据集将助力未来研究者探索晕动症与认知负荷的关系,推动更高效、舒适的虚拟环境设计。

原文摘要 · Abstract (English)

Virtual Reality (VR) is quickly establishing itself in various industries, including training, education, medicine, and entertainment, in which users are frequently required to carry out multiple complex cognitive and physical activities. However, the relationship between cognitive activities, physical activities, and familiar feelings of cybersickness is not well understood and thus can be unpredictable for developers. Researchers have previously provided labeled datasets for predicting cybersickness while users are stationary, but there have been few labeled datasets on cybersickness while users are physically walking. Thus, from 39 participants, we collected head orientation, head position, eye tracking, images, physiological readings from external sensors, and the self-reported cybersickness severity, physical load, and mental load in VR. Throughout the data collection, participants navigated mazes via real walking and performed tasks challenging their attention and working memory. To demonstrate the dataset's utility, we conducted a case study of training classifiers in which we achieved 95% accuracy for cybersickness severity classification. The noteworthy performance of the straightforward classifiers makes this dataset ideal for future researchers to develop cybersickness detection and reduction models. To better understand the features that helped with classification, we performed SHAP(SHapley Additive exPlanations) analysis, highlighting the importance of eye tracking and physiological measures for cybersickness prediction while walking. This open dataset can allow future researchers to study the connection between cybersickness and cognitive loads and develop prediction models. This dataset will empower future VR developers to design efficient and effective Virtual Environments by improving cognitive load management and minimizing cybersickness.

VR晕动症眼动追踪认知负荷数据集

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。