首个面向多轮网页代码迭代修改的评测基准,填补真实开发流程空白。
MT-Web2Code: Benchmarking Coding Agents on Multi-Turn Regional Reconstruction and Localized Modification

- 构建反向缺陷注入引擎,自动生成可复现的修复轨迹。
- 多轮修复中区域重建准确率仅42.3%,局部修改存在视觉错位。
- 适合研究多轮交互式代码生成与前端自动化工具的开发者。
大型视觉语言模型在网页界面生成方面表现突出,但现有评测多聚焦单轮从零生成,忽视了真实前端工程中反复重构局部区域与修改特定元素的迭代流程。为此,我们提出MT-Web2Code,首个面向多轮宏观区域重建与微观局部修改的多模态编码评测基准,包含102个覆盖16个垂直领域的任务。为避免高成本的人工标注,我们设计了可扩展的逆向缺陷注入引擎,通过逐步引入结构与风格缺陷生成确定性修复路径。进一步提出双轴评估协议:区域重建采用基于5维VLM的评分标准,局部修改则通过像素级精准对齐进行判定。在13个前沿编码代理上的实验表明,当前模型在多轮操作中难以同时保证目标区域还原度与未受影响内容的完整性,缺乏细粒度视觉-代码对齐能力,且错误随轮次累积加剧。本工作不仅提供评测平台,其确定性评估指标还可为未来训练迭代式网页代码生成代理提供精细化反馈。代码与数据将陆续公开。
原文摘要 · Abstract (English)
Recent advances in Large Vision-Language Models (LVLMs) have demonstrated impressive capabilities in web UI generation. However, existing benchmarks predominantly focus on single-turn full-page generation from scratch, overlooking the iterative workflow of real-world frontend engineering, where developers repeatedly reconstruct missing regions and modify localized elements within existing codebases. To bridge this gap, we introduce MT-Web2Code, the first multimodal coding benchmark for multi-turn Macro-Level Regional Reconstruction and Micro-Level Localized Modification, which contains 102 tasks spanning 16 vertical domains. To construct deterministic repair trajectories without costly turn-level human annotation, we develop a scalable Reverse-Corruption Trajectory Engine that iteratively injects structural and stylistic defects into golden pages. We further propose a dual-axis evaluation protocol that measures target-region fidelity and the preservation of unaffected content, where regional reconstruction is assessed by a 5-dimensional VLM-based rubric and localized modification by deterministic pixel-grounded alignment. Experiments on 13 frontier coding agents reveal that current agents struggle to faithfully reconstruct target regions while preserving unaffected content, lack fine-grained visual-code alignment for localized edits, and suffer from error snowballing over multiple turns. Beyond benchmarking, our deterministic evaluation metrics provide fine-grained feedback signals that may facilitate future research on training iterative UI coding agents. Our evaluation code and data will soon be released.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。