arXiv:2603.00825cs.CV2026-03被引 1

用扩散模型训练可实时响应玩家动作的智能对手,无需显式标注对手行为。

COMBAT: Conditional World Models for Behavioral Agent Training

  • 基于12亿参数扩散变换器,用压缩编码器潜变量控制环境动态
  • 仅用单人游戏数据训练,即生成能主动反击的复杂对手行为
  • 适合研究交互式代理训练与基于扩散模型的世界建模

近期视频生成进展推动了3D一致环境与静态物体交互的模拟世界模型发展,但对动态、反应型代理的建模仍存在显著局限。为此,本文提出COMBAT,一种基于复杂1v1格斗游戏Tekken 3训练的实时、动作可控世界模型。研究表明,扩散模型可成功模拟随玩家动作即时响应的动态对手,其行为通过隐式学习获得。该方法采用12亿参数扩散变换器,以深度压缩自编码器的潜变量为条件,并结合因果蒸馏与扩散强迫等先进技巧实现实时推理。关键在于,仅使用单人输入数据训练,无需对手策略的显式监督,即可涌现出复杂交互行为。不同于传统模仿学习需完整动作标签,COMBAT从部分观测数据中有效学习,生成可控玩家1的响应行为。本文开展全面评估并提出新型评测方法,验证了涌现行为的有效性,为扩散模型中交互代理的训练奠定坚实基础。

原文摘要 · Abstract (English)

Recent advances in video generation have spurred the development of world models capable of simulating 3D-consistent environments and interactions with static objects. However, a significant limitation remains in their ability to model dynamic, reactive agents that can intelligently influence and interact with the world. To address this gap, we introduce COMBAT, a real-time, action-controlled world model trained on the complex 1v1 fighting game Tekken 3. Our work demonstrates that diffusion models can successfully simulate a dynamic opponent that reacts to player actions, learning its behavior implicitly. Our approach utilizes a 1.2 billion parameter Diffusion Transformer, conditioned on latent representations from a deep compression autoencoder. We employ state-of-the-art techniques, including causal distillation and diffusion forcing, to achieve real-time inference. Crucially, we observe the emergence of sophisticated agent behavior by training the model solely on single-player inputs, without any explicit supervision for the opponent's policy. Unlike traditional imitation learning methods, which require complete action labels, COMBAT learns effectively from partially observed data to generate responsive behaviors for a controllable Player 1. We present an extensive study and introduce novel evaluation methods to benchmark this emergent agent behavior, establishing a strong foundation for training interactive agents within diffusion-based world models.

世界模型扩散模型强化学习游戏代理

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。