WEAVER世界模型让机器人模拟更准更快更持久,显著提升操作性能。
WEAVER, Better, Faster, Longer: An Effective World Model for Robotic Manipulation

- 多视角建模+流匹配损失,预测未来状态与奖励值。
- 真实成功率相关性达0.870,策略提升38%,规划速度超前5-10倍。
- 适用于长时序任务与分布外场景,适合机器人实时决策研究者。
世界模型(WMs,即学习型模拟器)在机器人领域具有深远影响——可用于策略评估、策略改进和测试时规划,且仅需极少真实交互。为实现这些下游能力,WM需同时满足三个要求:(i) 精度(模拟轨迹与现实高度相关),(ii) 一致性(长期轨迹保持连贯),(iii) 效率(快速生成模拟轨迹)。我们提出 WEAVER(World Estimation Across Views for Embodied Reasoning):一种能同时满足三者的新架构,在机器人操作任务上达到当前最优表现。WEAVER 是一种多视角世界模型,通过流匹配损失预测未来隐状态和奖励值。我们提炼出在模型结构、记忆机制与预测目标方面的关键设计,使模型能够处理此前难以应对的长时序动态操作任务。我们在真实机器人硬件上应用 WEAVER,验证其有效性:策略评估相关性 $ρ=0.870$,策略改进带来 $38\\$ 的真实成功率提升(基于 $π_{0.5}$ 基础模型),测试时规划实现 $14\%$ 提升并获得 $5{-}10\times$ 速度优势。此外,WEAVER 在分布外场景下也优于先前模型。代码、模型与视频见:https://arnavkj1995.github.io/WEAVER/
原文摘要 · Abstract (English)
The potential impacts of world models (WMs, i.e., learned simulators) on robotics are far-reaching -- policy evaluation, policy improvement, and test-time planning -- all with limited real-world interaction. To unlock these downstream capabilities, a WM needs to jointly satisfy three desiderata: $\textit{(i)}$ fidelity (i.e., producing simulated trajectories that correlate with reality), $\textit{(ii)}$ consistency (i.e., producing simulated trajectories that are coherent over long horizons), and $\textit{(iii)}$ efficiency (i.e., producing simulated trajectories quickly). We propose WEAVER (World Estimation Across Views for Embodied Reasoning): a WM architecture that simultaneously achieves all three desiderata, providing state-of-the-art results on robotic manipulation tasks. WEAVER is a multi-view WM trained to predict future latents and reward values via a flow-matching loss. We distill the key design decisions across model architecture, memory, and prediction objectives required to unlock the kinds of long-horizon dynamic manipulation tasks that have confounded prior world modeling approaches. We apply WEAVER in robotic hardware, demonstrating its effectiveness at policy evaluation ($ρ$=0.870 correlation with real-world success rate), policy improvement (real-world success rate improvement of $38\%$ on top of the $π_{0.5}$ robot foundation model), and test-time planning (real-world success rate improvement of $14\%$ with a $5-10\times$ speedup over prior WMs). WEAVER also demonstrates better performance than prior WMs when evaluated on out-of-distribution scenarios. Code, models, and videos at: https://arnavkj1995.github.io/WEAVER/ .
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。