构建全维度评测体系,检验驾驶世界模型的视觉真实与行为可信度
WorldLens: Full-Spectrum Evaluations of Driving World Models in Real World

- 设计五维评估框架:生成、重建、动作跟随、下游任务与人类偏好
- 发现现有模型在纹理真实与物理合理间难以兼顾,无模型全面领先
- 推出26K规模人类标注数据集与可解释评分代理,对齐人机评价标准
生成式世界模型正重塑具身智能,使智能体能合成看似逼真的4D驾驶环境,但常在物理或行为层面失效。尽管进展迅速,领域仍缺乏统一评估方法来判断生成世界是否保持几何一致性、遵循物理规律或支持可靠控制。我们提出WorldLens,一个涵盖生成、重建、动作跟随、下游任务和人类偏好的全谱评测基准,综合衡量视觉真实、几何一致、物理合理与功能可靠性。跨维度评估显示,现有模型无一在所有方面均表现优异:纹理强的模型常违反物理规律,几何稳定的模型则缺乏行为保真度。为对齐客观指标与人类判断,我们构建了包含26,000条带分数与文本理由的人类标注视频数据集WorldLens-26K,并开发基于标注数据蒸馏的WorldLens-Agent评估模型,实现可扩展、可解释的评分。三者共同构成统一生态,推动未来模型不仅被看其外观是否真实,更被验其行为是否可信。
原文摘要 · Abstract (English)
Generative world models are reshaping embodied AI, enabling agents to synthesize realistic 4D driving environments that look convincing but often fail physically or behaviorally. Despite rapid progress, the field still lacks a unified way to assess whether generated worlds preserve geometry, obey physics, or support reliable control. We introduce WorldLens, a full-spectrum benchmark evaluating how well a model builds, understands, and behaves within its generated world. It spans five aspects -- Generation, Reconstruction, Action-Following, Downstream Task, and Human Preference -- jointly covering visual realism, geometric consistency, physical plausibility, and functional reliability. Across these dimensions, no existing world model excels universally: those with strong textures often violate physics, while geometry-stable ones lack behavioral fidelity. To align objective metrics with human judgment, we further construct WorldLens-26K, a large-scale dataset of human-annotated videos with numerical scores and textual rationales, and develop WorldLens-Agent, an evaluation model distilled from these annotations to enable scalable, explainable scoring. Together, the benchmark, dataset, and agent form a unified ecosystem for measuring world fidelity -- standardizing how future models are judged not only by how real they look, but by how real they behave.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。