arXiv:2605.29397cs.CL2026-05

提出轻量评估框架,高效筛选网页信息压缩方法。

Revisiting Observation Reduction for Web Agents: Comprehensive Evaluation with a Lightweight Framework

论文配图:Revisiting Observation Reduction for Web Agents: Comprehensive Evaluation with a Lightweight Framework
图 1 · 摘自论文原文
  • 基于最小失败集构建无须运行的评估指标
  • 压缩后任务成功率保持84%~89%,速度提升2.2~3.1倍
  • 适合需要快速验证网页代理优化策略的研究者

基于大模型的网页代理面临HTML观察信息过长的问题,尽管已有多种压缩方法,但缺乏有效评估手段。现有端到端评估成本极高:在WorkArena L1的33个任务上,评估11种方法、32种配置需累计232.4小时。为此,本文提出基于最小失败集(MFS)的轻量评估框架,以保留MFS的比例作为代理指标,无需网络访问或大模型推理。实验表明该指标与最终成功率强相关,在两个基准上实现超100倍加速。利用该框架发现,抽取式压缩方法需高算力或领域调优才能兼顾延迟与性能。基于MFS训练数据优化剪枝程序后,在WorkArena L1上实现2.2倍提速且保留84%成功率,在WebLinx上达3.1倍提速并保持89%成功率。

原文摘要 · Abstract (English)

HTML observations in LLM-based web agents are extremely long, and while many reduction methods have been proposed, it remains unclear which methods reduce overall agent latency while maintaining performance. The main obstacle is the high cost of end-to-end evaluation: in our experiments, evaluating 11 methods across 32 configurations on 33 tasks of WorkArena L1 required 232.4 cumulative hours. To address this, we propose a lightweight evaluation framework based on the Minimal Failure Set (MFS), the minimal set of HTML elements whose removal causes task failure. We define coverage as the fraction of instances in which a reduction method fully retains the MFS, which serves as a proxy metric that requires neither web access nor LLM inference. We validate that coverage strongly correlates with end-to-end success rate, with over 100$\times$ speedup in cumulative evaluation time on both benchmarks. Using this framework, we find that extractive HTML reduction methods require either high computation cost or domain-specific optimization to reduce agent latency while maintaining performance. Building on this, we optimize a pruning program on MFS training data, achieving 2.2$\times$ faster per-step latency on WorkArena L1 while retaining 84\% of the original success rate, and 3.1$\times$ faster on WebLinx while retaining 89\%.

网页代理信息压缩评估框架轻量化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。