用模块化生成框架实现每秒1.5万帧的实时动作合成。
MotionBricks: Scalable Real-Time Motions with Modular Latent Generative Model and Smart Primitives

- 采用模块化潜空间生成模型,统一建模超35万段动作片段。
- 实测支持2毫秒延迟、每秒1.5万帧生成,性能达当前最优。
- 无需动画经验即可拼装控制动作,适合游戏与机器人开发。
尽管生成式动作合成取得突破进展,但实时交互控制仍以传统方法为主。本文指出两大核心挑战:一是实时可扩展性——产业应用需在实时计算约束下生成海量动作技能,而现有生成方法质量与扩展性显著下降;二是集成性——产业需求精细多模态控制(如速度指令、风格选择、关键帧),现有文本或标签驱动模型难以满足。为此,我们提出MotionBricks:一种大规模、实时生成框架。首先,设计一个面向实时生成的模块化潜空间骨干网络,单模型即可有效建模超过35万段动作数据。其次,引入智能原子单元,提供统一、鲁棒且直观的动作创作接口,支持导航与物体交互的即插即用式编排。定量结果表明,MotionBricks在开源与专有数据集上均达到领先动作质量,同时实现15,000 FPS吞吐量与2毫秒延迟。我们在完整生产级动画演示中验证了其跨风格、跨任务的灵活性与鲁棒性。此外,将MotionBricks部署于Unitree G1人形机器人,展示了其在实时机器人控制中的泛化能力。
原文摘要 · Abstract (English)
Despite transformative advances in generative motion synthesis, real-time interactive motion control remains dominated by traditional techniques. In this work, we identify two key challenges in bridging research and production: 1) Real-time scalability: Industry applications demand real-time generation of a vast repertoire of motion skills, while generative methods exhibit significant degradation in quality and scalability under real-time computation constraints, and 2) Integration: Industry applications demand fine-grained multi-modal control involving velocity commands, style selection, and precise keyframes, a need largely unmet by existing text- or tag-driven models. To overcome these limitations, we introduce MotionBricks: a large-scale, real-time generative framework with a two-fold solution. First, we propose a large-scale modular latent generative backbone tailored for robust real-time motion generation, effectively modeling a dataset of over 350,000 motion clips with a single model. Second, we introduce smart primitives that provide a unified, robust, and intuitive interface for authoring both navigation and object interaction. Applications can be designed in a plug-and-play manner like assembling bricks without expert animation knowledge. Quantitatively, we show that MotionBricks produces state-of-the-art motion quality on open-source and proprietary datasets of various scales, while also achieving a real-time throughput of 15,000 FPS with 2ms latency. We demonstrate the flexibility and robustness of MotionBricks in a complete production-level animation demo, covering navigation and object-scene interaction across various styles with a unified model. To showcase our framework's application beyond animation, we deploy MotionBricks on the Unitree G1 humanoid robot to demonstrate its flexibility and generalization for real-time robotic control.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。