arXiv:2511.00002cs.LGcs.AI2025-11

用AI自动玩VR游戏,实时检测质量问题。

VRScout: Towards Real-Time, Autonomous Testing of Virtual Reality Games

  • 基于人类示范训练的智能代理,模仿人类操作行为
  • 仅需少量数据即可达到专家级表现,60帧/秒实时运行
  • 适合游戏公司做质量检测和安全审查

虚拟现实(VR)游戏快速发展,但内容质量、安全性和适宜性保障仍面临挑战。传统人工测试耗时费力,难以跟上行业增长。尽管自动化测试已在2D/3D游戏中应用,但延伸至VR因高维感官输入与严格实时性要求而困难重重。我们提出VRScout,一种基于深度学习的智能体,可自主导航并以类人方式实时交互于VR环境。该模型采用增强型动作分块变换器,从人类示范中学习多步动作序列,捕捉高层策略并跨场景泛化。为兼顾响应速度与精度,引入动态可调滑动窗口,实时调整时间上下文。在商业VR游戏中评估显示,仅用有限训练数据即可实现专家级表现,且在消费级硬件上保持60帧/秒实时推理。结果表明,VRScout是可扩展的自动化测试框架,适用于质量保证与安全审计。

原文摘要 · Abstract (English)

Virtual Reality (VR) has rapidly become a mainstream platform for gaming and interactive experiences, yet ensuring the quality, safety, and appropriateness of VR content remains a pressing challenge. Traditional human-based quality assurance is labor-intensive and cannot scale with the industry's rapid growth. While automated testing has been applied to traditional 2D and 3D games, extending it to VR introduces unique difficulties due to high-dimensional sensory inputs and strict real-time performance requirements. We present VRScout, a deep learning-based agent capable of autonomously navigating VR environments and interacting with virtual objects in a human-like and real-time manner. VRScout learns from human demonstrations using an enhanced Action Chunking Transformer that predicts multi-step action sequences. This enables our agent to capture higher-level strategies and generalize across diverse environments. To balance responsiveness and precision, we introduce a dynamically adjustable sliding horizon that adapts the agent's temporal context at runtime. We evaluate VRScout on commercial VR titles and show that it achieves expert-level performance with only limited training data, while maintaining real-time inference at 60 FPS on consumer-grade hardware. These results position VRScout as a practical and scalable framework for automated VR game testing, with direct applications in both quality assurance and safety auditing.

VR测试智能代理自动化验证

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。