通过手部动作识别用户虚拟现实熟悉度,实现自适应交互。
Behavioral Biometrics for Automatic Detection of User Familiarity in VR
- 分析用户在输入密码开门任务中的手部运动模式
- 手柄与手势追踪分别达92.05%和83.42%识别准确率
- 跨设备融合提升至94.19%,适合个性化VR系统
随着虚拟现实(VR)设备日益融入日常场景,大量无经验用户将接触VR系统。实时自动检测用户对VR的熟悉程度,可实现动态训练与界面调整,减少挫败感并提升任务表现。本研究通过分析用户在基于密码的门禁操作任务中手部运动模式,探索自动识别VR熟悉度的方法。该任务是协作虚拟环境(如会议室、办公室、医疗空间)中的常见交互。尽管新手缺乏VR经验,但通常熟悉现实世界中的键盘输入任务。我们对26名参与者(经验者与新手各半)进行了初步研究,使用手柄与手势追踪两种交互方式完成任务。采用先进深度分类器,手柄与手势追踪的最高准确率分别为83.42%与92.05%。跨设备评估中(用控制器数据训练模型,测试于手势数据),准确率达78.89%;多模态融合后达到94.19%。结果表明,手部动作生物特征在关键VR应用中具有实时识别用户熟悉度的潜力,为个性化自适应体验奠定基础。
原文摘要 · Abstract (English)
As virtual reality (VR) devices become increasingly integrated into everyday settings, a growing number of users without prior experience will engage with VR systems. Automatically detecting a user's familiarity with VR as an interaction medium enables real-time, adaptive training and interface adjustments, minimizing user frustration and improving task performance. In this study, we explore the automatic detection of VR familiarity by analyzing hand movement patterns during a passcode-based door-opening task, which is a well-known interaction in collaborative virtual environments such as meeting rooms, offices, and healthcare spaces. While novice users may lack prior VR experience, they are likely to be familiar with analogous real-world tasks involving keypad entry. We conducted a pilot study with 26 participants, evenly split between experienced and inexperienced VR users, who performed tasks using both controller-based and hand-tracking interactions. Our approach uses state-of-the-art deep classifiers for automatic VR familiarity detection, achieving the highest accuracies of 92.05% and 83.42% for hand-tracking and controller-based interactions, respectively. In the cross-device evaluation, where classifiers trained on controller data were tested using hand-tracking data, the model achieved an accuracy of 78.89%. The integration of both modalities in the mixed-device evaluation obtained an accuracy of 94.19%. Our results underline the promise of using hand movement biometrics for the real-time detection of user familiarity in critical VR applications, paving the way for personalized and adaptive VR experiences.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。