arXiv:2511.19304cs.AIcs.CL2025-11被引 14

构建可自动生成的多样化环境,评估智能体跨环境学习能力。

AutoEnv: Automated Environments for Measuring Cross-Environment Agent Learning

  • 将环境拆解为转移、观测、奖励三部分,低成本生成36个异构环境。
  • 7个语言模型在新数据集上仅获12%-49%归一化奖励,显示挑战性。
  • 发现固定学习方法难跨环境扩展,需自适应选择策略,适合研究通用智能体。

人类能通过学习不同世界中的底层规律,在动态、观测和奖励结构各异的环境中自然适应。而现有智能体通常仅在单一领域内自我进化,隐含环境分布固定的假设。跨环境学习长期缺乏有效度量:既无可控、多样化的标准环境集合,也无统一的学习过程表征方式。本文分两步解决:首先提出AutoEnv框架,将环境视为转移、观测与奖励的可分解分布,平均仅需4.12美元即可生成异构世界;基于此构建了包含36个环境、358个验证关卡的AutoEnv-36数据集,7个语言模型在此取得12%-49%的归一化奖励,证明其挑战性。其次,将智能体学习形式化为以选择、优化、评估三阶段驱动的组件级过程,设计8种学习方法并在此数据集上评估。实验表明,单一方法随环境数量增加性能迅速下降,说明固定方法无法在异构环境中扩展;环境自适应选择方法虽显著提升表现,但随着方法空间扩大仍出现收益递减。这些结果凸显了可扩展跨环境泛化学习的必要性与当前局限,确立AutoEnv与AutoEnv-36作为该方向研究基准的地位。代码已开源。

原文摘要 · Abstract (English)

Humans naturally adapt to diverse environments by learning underlying rules across worlds with different dynamics, observations, and reward structures. In contrast, existing agents typically demonstrate improvements via self-evolving within a single domain, implicitly assuming a fixed environment distribution. Cross-environment learning has remained largely unmeasured: there is no standard collection of controllable, heterogeneous environments, nor a unified way to represent how agents learn. We address these gaps in two steps. First, we propose AutoEnv, an automated framework that treats environments as factorizable distributions over transitions, observations, and rewards, enabling low-cost (4.12 USD on average) generation of heterogeneous worlds. Using AutoEnv, we construct AutoEnv-36, a dataset of 36 environments with 358 validated levels, on which seven language models achieve 12-49% normalized reward, demonstrating the challenge of AutoEnv-36. Second, we formalize agent learning as a component-centric process driven by three stages of Selection, Optimization, and Evaluation applied to an improvable agent component. Using this formulation, we design eight learning methods and evaluate them on AutoEnv-36. Empirically, the gain of any single learning method quickly decrease as the number of environments increases, revealing that fixed learning methods do not scale across heterogeneous environments. Environment-adaptive selection of learning methods substantially improves performance but exhibits diminishing returns as the method space expands. These results highlight both the necessity and the current limitations of agent learning for scalable cross-environment generalization, and position AutoEnv and AutoEnv-36 as a testbed for studying cross-environment agent learning. The code is avaiable at https://github.com/FoundationAgents/AutoEnv.

智能体学习跨环境泛化自动环境生成

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。