用浏览器当世界模型,让AI自动修复网页代码并自我进化。
WebWorld: The Browser as a World Model for Self-Improving Web Code

- 让大模型通过与浏览器交互生成修复指令,由浏览器验证可行性。
- 在两个基准上提升显著,最高达14.9分,接近顶尖系统水平。
- 适合想构建自迭代网页生成系统的开发者或研究者。
视觉语言模型驱动的网页代码自改进存在结构性缺陷:提出修复方案的模型同时也是评判者,而视觉合理性并不能准确反映页面是否真正可用。该循环缺少一个模型无法欺骗的外部验证者,而浏览器正是这样的存在——它是对HTML行为的确定性、可执行模拟器,本质上就是网页代码的世界模型。本文提出WebWorld,即让视觉语言模型与浏览器作为世界模型自主交互,并决定哪些交互成为监督信号。每轮中,模型生成批评意见,规划器将其编译为带类型约束的交互契约;浏览器重新执行候选代码,仅当目标进展和所有先前验证的能力均保持时才签发接受证书;经认证的迁移累积形成质量递进机制,这也是最终监督微调数据唯一来源。在相同训练条件下,WebWorld-27B在HTMLBench-400上比Raw-27B提升5.3分,在MiniAppBench-Val上提升14.9分,达到如Kimi-K2.6和GPT-5.4等强前沿系统水平。同等规模消融实验表明,浏览器背书的准入机制是性能提升的关键:若无证书机制,9B规模的提升几乎消失。
原文摘要 · Abstract (English)
VLM-driven self-improvement of web code has a structural flaw: the model that proposes the repair is the model that judges it, and visual plausibility under that judge is a poor proxy for whether the page actually works. What the loop is missing is a counterparty the VLM cannot fool, and the browser already is that counterparty: a deterministic, executable simulator of how an HTML artifact behaves under user actions, and in everything but name a world model for web code. We present WebWorld, the interface that lets a VLM prior interact with this browser-as-world-model autonomously and decides which interactions become supervision. Each round, the VLM emits a critique that the planner compiles into a typed interaction contract; the browser re-executes the candidate and issues an acceptance certificate only when both target progress and preservation of every previously verified capability hold; certified transitions accumulate as a quality ratchet that is the only thing the SFT export ever sees. Under matched training, WebWorld-27B improves Raw-27B by 5.3 points on HTMLBench-400 and 14.9 points on MiniAppBench-Val, and reaches the level of strong frontier systems such as Kimi-K2.6 and GPT-5.4 on interactive HTML generation. Equal-size ablations show that browser-backed admission carries the gain: without the certificate, the matched 9B lift nearly disappears.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。