用可复用的潜在轨迹先验,让世界模型自动规划动作,提速十倍还更准。
LeFlow: Generative Latent Flow Planning for World Models

- 把规划转为潜空间中的轨迹生成,用流模型预设未来路径。
- 在四个基准上成功率提升,规划时间减少一个数量级。
- 适合需要快速决策的机器人控制场景,如自动驾驶、机械臂操作。
潜在世界模型能高效编码图像为潜在表示,但现有方法仍依赖在线轨迹优化进行动作规划:对每个状态-目标对,从头开始迭代优化寻找最优动作序列,将世界模型视为黑箱模拟器。这导致每次重规划都要支付完整优化成本,且无法复用过往规划经验。本文提出LeFlow,学习一个可在潜在动态空间中直接运行的可复用潜轨迹先验。LeFlow将规划重构为条件潜轨迹生成:通过修正流模型生成从当前到目标潜表示的未来路径,逆动力学解码器将潜转移转换为动作块,冻结的世界模型通过自回归滚动验证候选方案。在四个主要的目标条件像素控制基准上,LeFlow以固定预算的滚动选择替代迭代动作空间优化,实现一致的成功率提升,并使规划时间减少一个数量级。结果表明,潜在世界模型应支持预测之外的可复用规划先验。代码已开源:https://github.com/hsiangwei0903/LeFlow。
原文摘要 · Abstract (English)
Latent world models are inherently strong encoders that transform image pixel to latent embedding, yet existing world models still rely on online trajectory optimization for action planning: for every state-goal pair, an iterative optimizer is run from scratch to search for optimal action sequences, treating the world model as a black-box simulator. This approach pays the full iterative optimization cost anew at every replanning step and reuses no planning experience across queries. In this work, we ask whether planning itself can be amortized once a latent world model has been learned. We present LeFlow, which learns a reusable latent trajectory prior operating directly in the latent dynamics space from the world model. LeFlow recasts planning as conditional latent trajectory generation: a rectified-flow model imagines a future latent path between the current and goal embeddings, an inverse dynamics decoder turns latent transitions into action chunks, and the frozen world model verifies each candidate by autoregressive rollout. Across four major goal-conditioned pixel-control benchmarks, LeFlow replaces iterative action-space optimization with amortized latent planning and fixed-budget rollout selection, achieving consistent success-rate gains with an order-of-magnitude reduction in planning time. Our results argue that latent world models should support not only prediction but reusable planning priors. Our code is available at https://github.com/hsiangwei0903/LeFlow.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。