arXiv:2511.20095cs.CV2025-11中稿 · ed被引 4

通过在线世界模型蒸馏,实现高效安全的策略迁移。

WPT: World-to-Policy Transfer via Online World Model Distillation

  • 用世界模型预测未来动态,指导策略训练。
  • 开环碰撞率0.11,闭环驾驶得分79.23,性能领先。
  • 学生模型推理快4.9倍,适合实时部署场景。

近年来,世界模型在捕捉智能体动作与环境演化之间的时空关联方面取得显著进展。然而,现有方法通常存在运行时强耦合或依赖离线奖励信号的问题,导致推理开销大或阻碍端到端优化。为此,我们提出WPT(World-to-Policy Transfer),一种基于端到端世界模型引导的在线蒸馏训练范式。我们设计了一个可训练的奖励模型,通过将候选轨迹与世界模型预测的未来动态对齐,将世界知识注入教师策略。随后,提出策略蒸馏与世界奖励蒸馏,将教师策略的推理能力迁移到轻量级学生策略中,在提升规划性能的同时保持实时部署能力。在开环与闭环比基准上的大量实验表明,WPT以简单策略架构实现了顶尖性能:开环碰撞率为0.11,闭环比驾驶得分为79.23,优于基于世界模型及模仿学习的方法,在准确性和安全性上均有突破。此外,学生模型推理速度最快可达4.9倍提升,同时保留大部分性能增益。

原文摘要 · Abstract (English)

Recent years have witnessed remarkable progress in world models, which primarily aim to capture the spatio-temporal correlations between an agent's actions and the evolving environment. However, existing approaches often suffer from tight runtime coupling or depend on offline reward signals, resulting in substantial inference overhead or hindering end-to-end optimization. To overcome these limitations, we introduce WPT, a World-to-Policy Transfer training paradigm that enables online distillation under the guidance of an end-to-end world model. Specifically, we develop a trainable reward model that infuses world knowledge into a teacher policy by aligning candidate trajectories with the future dynamics predicted by the world model. Subsequently, we propose policy distillation and world reward distillation to transfer the teacher's reasoning ability into a lightweight student policy, enhancing planning performance while preserving real-time deployability. Extensive experiments on both open-loop and closed-loop benchmarks show that our WPT achieves state-of-the-art performance with a simple policy architecture: it attains a 0.11 collision rate (open-loop) and achieves a 79.23 driving score (closed-loop) surpassing both world-model-based and imitation-learning methods in accuracy and safety. Moreover, the student sustains up to 4.9x faster inference, while retaining most of the gains.

世界模型策略蒸馏实时推理自动驾驶

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。