扩展多模态、多功能与多平台的具身世界模型评测基准
WorldArena 2.0: Extending Embodied World Model Benchmarking on Modality, Functionality and Platform

- 从纯视觉扩展到视觉触觉多模态感知评估
- 支持世界模型作为交互式强化学习环境用于策略优化
- 覆盖模拟与真实机器人多种平台,支持跨平台性能测试
具身世界模型已成为具身智能的核心范式,使智能体能够预测动作条件下的未来并推理环境动态。然而,现有具身世界模型评测基准仍局限于纯视觉预测、离线应用和基于模拟器的评估,难以全面衡量日益复杂的模型。本文提出 WorldArena 2.0,系统性地从三个维度扩展评测:模态、功能与平台。在模态维度,从纯视觉拓展至视觉触觉多模态,评估多模态感知与预测能力;在功能维度,从策略评估与规划扩展为将世界模型作为交互式强化学习环境以优化策略;在平台维度,突破仅限于模拟器,涵盖多种模拟与真实机器人场景及不同机器人本体。在统一协议下,全面评估感知质量、交互实用性与跨平台表现,提供追踪具身世界模型进展的综合性测试平台。基准代码与数据可访问:https://world-arena.ai。
原文摘要 · Abstract (English)
World models have emerged as a central paradigm for embodied intelligence, enabling agents to predict action-conditioned future and reason about environmental dynamics. However, existing embodied world model benchmarks are still largely confined to vision-only prediction, offline embodied applications, and simulator-based evaluation, making them insufficient for assessing increasingly comprehensive world models. In this work, we introduce WorldArena 2.0, an expanded benchmark that systematically broadens embodied world model evaluation along three dimensions: modality, functionality, and platform. Along the modality dimension, WorldArena 2.0 extends evaluation from vision-only to visuotactile modalities, enabling assessment of multimodal perception and prediction. Along the functionality dimension, it extends beyond policy evaluation and planning to assess world models as interactive RL environments for policy optimization. Along the platform dimension, it moves beyond simulator-only evaluation to a diverse suite of simulated and real-world robotic settings across multiple embodiments. Under a standardized protocol, WorldArena 2.0 comprehensively evaluates perceptual quality, interactive utility, and cross-platform performance, providing a comprehensive testbed for tracking progress toward embodied world models. The benchmark is available at: https://world-arena.ai.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。