让游戏视频生成更真实流畅,支持高动态交互与实时运行。
Hunyuan-GameCraft: High-dynamic Interactive Game Video Generation with Hybrid History Condition
- 将键盘鼠标输入统一为相机表示空间,实现精细动作控制。
- 基于百万级游戏录像训练,生成视频长期一致性更强。
- 模型压缩后仍保真,适合复杂场景实时交互应用。
基于扩散模型的可控视频生成技术已实现高质量、时序连贯的视频合成,为沉浸式互动游戏体验奠定基础。然而,现有方法在动态范围、泛化能力、长期一致性与效率方面仍存在局限,难以生成多样化的游戏视频。为此,我们提出 Hunyuan-GameCraft,一种面向游戏环境的高动态交互视频生成框架。为实现细粒度动作控制,我们将标准键盘与鼠标输入统一映射到共享相机表征空间,支持各类相机与移动操作间的平滑插值。进一步提出混合历史条件训练策略,在自回归扩展视频序列的同时保留游戏场景信息。为提升推理效率与可玩性,采用模型蒸馏技术降低计算开销,同时保持长时序的一致性,适用于复杂交互环境的实时部署。模型在超过100款AAA游戏的百万级游戏录像数据集上训练,并在精心标注的合成数据集上微调,显著提升视觉保真度、真实感与动作可控性。大量实验表明,Hunyuan-GameCraft显著优于现有模型,推动了交互式游戏视频生成的逼真度与可玩性发展。
原文摘要 · Abstract (English)
Recent advances in diffusion-based and controllable video generation have enabled high-quality and temporally coherent video synthesis, laying the groundwork for immersive interactive gaming experiences. However, current methods face limitations in dynamics, generality, long-term consistency, and efficiency, which limit the ability to create various gameplay videos. To address these gaps, we introduce Hunyuan-GameCraft, a novel framework for high-dynamic interactive video generation in game environments. To achieve fine-grained action control, we unify standard keyboard and mouse inputs into a shared camera representation space, facilitating smooth interpolation between various camera and movement operations. Then we propose a hybrid history-conditioned training strategy that extends video sequences autoregressively while preserving game scene information. Additionally, to enhance inference efficiency and playability, we achieve model distillation to reduce computational overhead while maintaining consistency across long temporal sequences, making it suitable for real-time deployment in complex interactive environments. The model is trained on a large-scale dataset comprising over one million gameplay recordings across over 100 AAA games, ensuring broad coverage and diversity, then fine-tuned on a carefully annotated synthetic dataset to enhance precision and control. The curated game scene data significantly improves the visual fidelity, realism and action controllability. Extensive experiments demonstrate that Hunyuan-GameCraft significantly outperforms existing models, advancing the realism and playability of interactive game video generation.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。