针对游戏直播画质失真,提出四类增强方法提升智能体鲁棒性。
Augmentations for Robust and Efficient Imitation Learning in Streamed Video Games

- 设计模拟网络延迟与压缩的时空增强,模仿像素块、模糊等画质问题。
- 在3个现代3D游戏中,增强训练使性能提升41%,网络延迟下损失仅7.45%。
- 适合研究高效游戏智能体或应对真实网络环境的开发者使用。
模仿学习可通过人类示范训练策略,将视觉观测映射为动作,以扩展游戏智能体在复杂3D环境中的能力。然而,示范数据收集成本高,且现代游戏常通过流媒体进行,网络延迟和压缩会引入时空相关的视觉伪影,导致测试时特征分布偏移。为此,我们提出流媒体增强方法,模拟低带宽网络下常见的四种伪影:像素块、拖影、全局模糊和鬼影。我们在预测逆动力学模型(PIDM)基础上实现该方法,该模型在学习的潜在空间中结合未来状态条件与逆动力学策略。在三个现代3D游戏任务中评估增强效果:在稳定流媒体条件下,使用时空增强训练的智能体相比无增强者性能最高提升41%;当引入网络延迟时,增强训练的智能体性能仅下降7.45%,而原始数据训练的智能体下降至原性能的49.82%。结果表明,针对流媒体场景定制的时空增强是训练鲁棒高效游戏智能体的简单而有效的方法。
原文摘要 · Abstract (English)
Imitation learning is an appealing way to scale game-playing agents to complex 3D environments by training policies to map visual observations to actions from human demonstrations. However, these demonstrations are expensive to collect and modern game-playing is often done through streaming in which network delay and compression introduce spatiotemporally correlated visual artifacts that can cause a covariance shift at test time. To address these challenges, we propose streaming augmentations that mimic four types of artifacts commonly encountered during streaming with low-bandwidth network connection: pixelated blocks and scrubs, global blur, and ghosting. We instantiate our approach on top of predictive inverse dynamics models (PIDM), which combine future-state conditioning with an inverse dynamics policy in a learned latent space, and evaluate the impact of our augmentations across three tasks in modern 3D video games. Under stable streaming conditions, agents trained with spatiotemporal augmentations achieve up to 41% higher evaluation performance compared to agents trained without augmentations under an identical data budget. When network lag is introduced, agents trained with augmentations degrade by only 7.45% vs 49.82% of the original performance for agents trained only with the original data. These results clearly indicate that spatiotemporal augmentations tailored for the streaming setting are a simple yet powerful tool to train robust and efficient game-playing agents.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。