构建40万条第一视角游戏数据,支持世界模型的交互式预测与理解。
EgoCS-400K: An Egocentric Gameplay Dataset for World Models

- 从专业比赛回放中提取动作、视角、状态等多模态轨迹数据
- 涵盖13张地图、超1000场对战,总时长超1万小时
- 适合研究游戏世界建模、动作预测与人机交互的学者
从公开的职业《反恐精英》比赛回放中构建EgoCS-400K,一个大规模第一人称视角游戏数据集。该数据集包含超过40万段第一人称视频和10,000小时以上的游戏时长,覆盖1,000多场比赛、40,000轮对战及13张地图,每轮有10个玩家视角。通过解析玩家状态、移动、按键输入、武器使用、视角变化和游戏事件,实现视觉与动作、状态、事件的精准时间对齐。数据支持动作条件下的未来预测、状态与事件感知的场景演进、回放引导的描述生成及代理第一人称行为理解等任务。该数据集为被动视频、可控模拟与真实具身数据之间提供了可扩展的桥梁。
原文摘要 · Abstract (English)
The shift from video generation to interactive world modeling places new demands on data: beyond captioned videos, world models require temporally aligned video-action-language trajectories grounded in the actions, camera motion, states, and events that drive future scene changes. However, such data is difficult to obtain at scale. Web video datasets offer broad visual coverage but lack executable actions and reliable states; robotic datasets provide action and state supervision but are costly and limited in scene diversity; and existing simulators often lack large-scale human-driven interaction trajectories. In this paper, we introduce EgoCS-400K, a large-scale replay-grounded egocentric Counter-Strike dataset for world models, built from public professional CS and CS2 match demos that preserve human gameplay trajectories and enable parsing, replaying, rendering, and temporal alignment. We extract player states, view directions, movements, keyboard/button inputs, view-angle changes, weapon usage, game events, and round-level context, and render clean first-person videos from the same trajectories. EgoCS-400K contains over 400,000 first-person videos and 10,000 hours of gameplay from more than 1,000 matches and 40,000 rounds, covering 13 maps and 10 player viewpoints per round. It supports a range of interactive visual modeling tasks, including action-conditioned future prediction, state- and event-aware scene rollout, replay-grounded captioning, and agent egocentric action understanding. By connecting visual observations with human actions, camera motion, game states, and events at scale, EgoCS-400K serves as a practical bridge between passive web videos, controllable game simulation, and costly real-world embodied data.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。