arXiv:2608.03689cs.AIcs.SE2026-08

构建动态评估框架,真实还原网页生成的交互与演化过程。

LiveEvalBench: Toward Open-World Evaluation for Web Generation

论文配图:LiveEvalBench: Toward Open-World Evaluation for Web Generation
图 1 · 摘自论文原文
  • 以协作评审流程模拟前端全生命周期评估
  • 跨模型对比准确率达92.3%,贴近专家判断
  • 支持新角色与维度灵活扩展,适合研究者与开发者

大型语言模型在生成可执行前端项目方面能力日益增强,但现有评测仍将其视为静态问题。我们认为前端产物具有互动性、实现方式多样且演进迅速,需采用新范式。为此,我们提出LiveEvalBench,一个自动化框架,将网页生成评估重构为智能体驱动、自适应且可扩展的过程。该框架通过构建工程师、代码工程师和UI测试员协同工作的评审流程,覆盖部署、代码审查到浏览器交互等全阶段。针对实现多样性,采用共享评分标准与基于具体产物的定制化指标相结合的自适应协议。框架还支持无需重设计即可增量引入新评估角色与维度。在多种真实场景下的实验表明,LiveEvalBench与人工专家判断高度一致,并能提供对前沿模型网页生成能力的细粒度洞察。代码已开源:https://github.com/wyysteelhead/LiveEvalBench。

原文摘要 · Abstract (English)

Large language models are increasingly capable of synthesizing executable frontend projects, yet existing benchmarks still treat web generation as a static evaluation problem. We argue that frontend artifacts demand a different paradigm: they are interactive rather than static, admit diverse yet equally valid implementations, and evolve faster than rigid pipelines can accommodate. To address these gaps, we present LiveEvalBench, an automated framework that reformulates web-generation evaluation as an agentic, adaptive, and extensible process. LiveEvalBench instantiates evaluation as a collaborative review workflow, in which a Build Engineer, a Code Engineer, and a UI Tester collectively gather evidence across the full lifecycle of a frontend project, from deployment and code inspection to browser-based interaction. To handle implementation diversity, an adaptive protocol couples shared rubrics for cross-model comparability with implementation-grounded criteria tailored to each artifact. The framework further supports incremental integration of new evaluator roles and assessment dimensions without pipeline redesign. Experiments across diverse real-world web-generation scenarios show that LiveEvalBench aligns closely with human expert judgment and provides fine-grained insights into frontier models' web generation capabilities. Code is available at https://github.com/wyysteelhead/LiveEvalBench

网页生成评估框架智能体评测

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。