构建开源VR测试平台,评估深度学习防晕动症系统在对抗攻击下的鲁棒性。
Adversarial VR: An Open-Source Testbed for Evaluating Adversarial Robustness of VR Cybersickness Detection and Mitigation
- 在Unity中搭建实时VR环境,集成DeepTCN与Transformer模型进行晕动症检测。
- 三种对抗攻击使Transformer模型准确率下降5.94倍,成功误导缓解机制。
- 开源平台助力开发者测试系统安全性,尤其适合关注沉浸体验的VR研究者。
基于深度学习(DL)的自动晕动症检测方法及自适应缓解技术可提升用户舒适度与交互体验。然而,近期研究表明这些系统易受对抗攻击:对传感器输入施加微小扰动会降低模型性能、引发错误缓解,破坏沉浸感。此外,缺乏专门用于评估此类系统在对抗条件下鲁棒性的开源测试平台,制约了其真实场景有效性评估。为此,本文提出Adversarial-VR,一个基于Unity开发的实时VR测试平台,用于评估基于深度学习的晕动症检测与缓解策略在对抗条件下的表现。该平台集成两个先进模型(DeepTCN与Transformer),在开源数据集MazeSick上训练,实现晕动症严重程度实时检测,并采用动态视觉隧道机制根据模型输出调整视野范围。为评估鲁棒性,引入三种先进对抗攻击:MI-FGSM、PGD与C&W,成功干扰缓解流程。实验使用定制化VR迷宫模拟与HTC Vive Pro Eye头显实现,代码已开源。结果表明,这些攻击能有效欺骗系统;例如,C&W攻击使基于Transformer的模型准确率下降5.94倍。
原文摘要 · Abstract (English)
Deep learning (DL)-based automated cybersickness detection methods, along with adaptive mitigation techniques, can enhance user comfort and interaction. However, recent studies show that these DL-based systems are susceptible to adversarial attacks; small perturbations to sensor inputs can degrade model performance, trigger incorrect mitigation, and disrupt the user's immersive experience (UIX). Additionally, there is a lack of dedicated open-source testbeds that evaluate the robustness of these systems under adversarial conditions, limiting the ability to assess their real-world effectiveness. To address this gap, this paper introduces Adversarial-VR, a novel real-time VR testbed for evaluating DL-based cybersickness detection and mitigation strategies under adversarial conditions. Developed in Unity, the testbed integrates two state-of-the-art (SOTA) DL models: DeepTCN and Transformer, which are trained on the open-source MazeSick dataset, for real-time cybersickness severity detection and applies a dynamic visual tunneling mechanism that adjusts the field-of-view based on model outputs. To assess robustness, we incorporate three SOTA adversarial attacks: MI-FGSM, PGD, and C&W, which successfully prevent cybersickness mitigation by fooling DL-based cybersickness models' outcomes. We implement these attacks using a testbed with a custom-built VR Maze simulation and an HTC Vive Pro Eye headset, and we open-source our implementation for widespread adoption by VR developers and researchers. Results show that these adversarial attacks are capable of successfully fooling the system. For instance, the C&W attack results in a $5.94x decrease in accuracy for the Transformer-based cybersickness model compared to the accuracy without the attack.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。