arXiv:2608.27549cs.CV2026-08被引 1

用可执行代码构建物理世界模型,实现精准可控的物理推理。

Code as Worlds: Agentic Discovery of Executable World Representations for Physical Reasoning

论文配图:Code as Worlds: Agentic Discovery of Executable World Representations for Physical Reasoning
图 1 · 摘自论文原文
  • 将物理世界表示为可运行的代码,包含状态、参数与动态演化机制。
  • 在QuantiPhy数据集上超越领先闭源模型,达到当前最佳性能。
  • 适合需要可解释、可干预物理推理的研究者和开发者。

物理理解与推理依赖于对世界的紧凑且可泛化的表征。尽管现代视觉语言模型能识别并解释多样化的物理事件,但常缺乏对底层机制(如物体状态、物理参数、支配动力学)的显式表征,难以可靠推断世界如何演变及对外部干预的响应。本文提出「代码即世界」(Code-as-World)范式,通过可执行代码表达物理构成、动态演化与视觉呈现,构建紧凑、量化基础且可控制的物理世界抽象。为从多模态观测(如自然语言描述或真实视频)中构建此类表征,我们设计了一种受溯因推理启发的智能体发现循环:智能体提出、执行、渲染、验证并迭代优化可执行世界假设。作为具体应用,我们利用经验证的可执行世界为视觉语言模型提供可扩展的物理监督,用于定量物理推理训练。实验表明,Code-as-World-VL在QuantiPhy数据集上达到当前最优性能,显著超越领先闭源模型,凸显了可执行世界表征作为物理智能可扩展基础的巨大潜力。

原文摘要 · Abstract (English)

Physical understanding and reasoning depend on forming compact and generalizable representations of the world. While modern vision-language models can recognize and explain diverse physical events, they often lack explicit representations of the underlying mechanisms-such as object states, physical parameters, and governing dynamics-needed for reliably reasoning how the world evolves and responds to interventions. In this work, we introduce Code-as-World, a paradigm that represents physical worlds through executable world representations. By expressing physical composition, dynamic evolution, and visual appearance as executable code, Code-as-World provides a compact, quantitatively grounded, and controllable abstraction of the physical world. To construct such representations from multimodal observations, such as natural-language descriptions or real-world videos, we develop an agentic discovery loop inspired by abductive reasoning, where an agent proposes, executes, renders, verifies, and iteratively refines executable world hypotheses. As a concrete application, we use verified executable worlds to provide scalable physical supervision for training vision-language models on quantitative physical reasoning. Experiments show that Code-as-World-VL achieves state-of-the-art performance on QuantiPhy and surpasses leading proprietary models, highlighting the potential of executable world representations as a scalable foundation for physical intelligence.

物理推理可执行代码多模态学习智能体发现

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。