arXiv:2608.29305cs.CLcs.AI2026-08

让大模型在测试时自分解网页环境,提升真实场景下的自动化能力

Learning Simple Test-Time Environments for LLM Web Agents

论文配图:Learning Simple Test-Time Environments for LLM Web Agents
图 1 · 摘自论文原文
  • 测试时通过试错将复杂网页拆解为简单子模块
  • 在真实任务中提升组合泛化能力,性能显著改善
  • 无需标签,适合部署在动态变化的网页环境中

大型语言模型(LLM)代理在人工构建的环境中表现出色,但在复杂真实场景中性能常大幅下降。现有研究多归因于LLM在多个简单结构化环境组合上的组合泛化能力不足。本文提出,LLM网页代理可在测试时学习简单环境观测。具体而言,引入试错步骤使代理能将复杂环境观测分解为子模块,并实现一种无标签学习方法——测试时环境分解(TTED),在推理过程中通过经验自适应行为。实证评估显示该框架在合成与真实基准上均有效:(1) 在较简单子环境中获得的经验可有效组合以提升完整环境下的表现;(2) 在子环境中进行测试时训练能显著增强代理在真实网页自动化任务中的组合泛化能力。同时提供了无标签学习算法设计的关键洞见。随着LLM代理接触更复杂环境,我们认为在测试时学习环境分解技能对实现鲁棒的真实世界部署至关重要。

原文摘要 · Abstract (English)

Large language model (LLM) agents have demonstrated remarkable proficiency in manually constructed environments, yet their performance frequently collapses when transitioned to complex real-world settings. Existing research largely attribute this degradation to the compositional generalization gaps in LLMs on combinations of multiple simple, well-structured environments. In this work, we propose that LLM web agents can learn simple environment observations at test time. Specifically, we introduce trial steps for agents to decompose a complex environment observation into sub-modules, and implement a label-free learning method, Test-Time Environment Decomposition (TTED), to adapt agent behaviors with experience during inference. Our empirical evaluations demonstrate the framework's efficacy across both synthetic and realistic benchmarks, showing (1) experience gains acquired within simpler sub-environments can be effectively composed to improve performance in the full one, and (2) test-time training on sub-environments can significantly enhance the compositional generalization of agents in real-world web automation tasks. We also provide key insights in the design of the label-free learning algorithm. As more complex environments are accessed by LLM agents, we believe learning environment decomposition skills at test time will be critical for robust real-world deployment.

大模型代理网页自动化测试时学习环境分解

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。