arXiv:2604.22152cs.RO2026-04被引 6

用离散扩散模型加速机器人策略的大规模评估

dWorldEval: Scalable Robotic Policy Evaluation via Discrete Diffusion World Model

论文配图:dWorldEval: Scalable Robotic Policy Evaluation via Discrete Diffusion World Model
图 1 · 摘自论文原文
  • 将视觉、语言、动作统一映射到令牌空间,用单个Transformer去噪建模
  • 通过关键帧记忆和进度令牌实现时空一致性和任务完成自动判定
  • 在多个真实机器人任务上超越现有方法,适合大规模机器人评估场景

在数千个环境和任务中评估机器人策略对现有方法而言不可行。本文提出dWorldEval,利用离散扩散世界模型作为可扩展的机器人策略评估代理。具体地,dWorldEval将视觉、语言和机器人动作等多模态信息映射到统一的令牌空间,并通过单一Transformer-based去噪网络进行建模。在此架构基础上,采用稀疏关键帧记忆维持时空一致性,并引入表示任务完成度的进度令牌。推理时,模型联合预测未来观测和进度令牌,当进度达到1时自动判定任务成功。大量实验表明,dWorldEval在LIBERO、RoboTwin及多个真实机器人任务上显著优于WorldEval、Ctrl-World和WorldGym。该方法为构建大规模机器人评估的世界模拟器开辟了新范式。

原文摘要 · Abstract (English)

Evaluating robotics policies across thousands of environments and thousands of tasks is infeasible with existing approaches. This motivates the need for a new methodology for scalable robotics policy evaluation. In this paper, we propose dWorldEval, which uses a discrete diffusion world model as a scalable evaluation proxy for robotics policies. Specifically, dWorldEval maps all modalities - including vision, language, and robotic actions - into a unified token space, modeling them via a single transformer-based denoising network. In this paper, we propose dWorldEval, using a discrete diffusion world model as a scalable evaluation proxy for robotics policy. Specifically, it maps all modalities, including vision, language, and robotics action into a unified token space, then denoises them with a single transformer network. Building on this architecture, we employ a sparse keyframe memory to maintain spatiotemporal consistency. We also introduce a progress token that indicates the degree of task completion. At inference, the model jointly predicts future observations and progress token, allowing automatically determine success when the progress reaches 1. Extensive experiments demonstrate that dWorldEval significantly outperforms previous approaches, i.e., WorldEval, Ctrl-World, and WorldGym, on LIBERO, RoboTwin, and multiple real-robot tasks. It paves the way for a new architectural paradigm in building world simulators for robotics evaluation at scale.

机器人评估扩散模型多模态建模仿真

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。