通过自动生成接口提升大模型智能体与环境的对齐,显著改善决策性能。
Agent-Environment Alignment via Automated Interface Generation
- 设计自动接口生成框架,增强环境信息和观测反馈
- 在ALFWorld等任务中实现最高45.67%的成功率提升
- 无需修改智能体或环境代码,适配不同模型架构
大型语言模型(LLM)智能体在交互式决策任务中展现出强大推理能力,但其与环境之间的交互依赖于中间接口(如预定义动作空间和规则),常因智能体对动作影响的预期与环境实际状态转移不一致,导致「智能体-环境错位」问题。本文实证表明,该错位是制约智能体性能的关键瓶颈。为此,提出ALIGN框架——一种自动对齐接口生成方法,通过丰富接口中的静态环境信息与步骤观测反馈来缓解错位。该接口以轻量级封装形式实现,无需修改智能体逻辑或环境代码。在具身任务、网页导航和工具使用等多个领域实验显示,性能稳定提升,尤其在ALFWorld中成功率最高提升45.67%。且生成接口可跨不同智能体架构和大模型底座通用,无需重新生成。代码与结果已公开于https://github.com/THUNLP-MT/ALIGN。
原文摘要 · Abstract (English)
Large language model (LLM) agents have shown impressive reasoning capabilities in interactive decision-making tasks. These agents interact with environment through intermediate interfaces, such as predefined action spaces and interaction rules, which mediate the perception and action. However, mismatches often happen between the internal expectations of the agent regarding the influence of its issued actions and the actual state transitions in the environment, a phenomenon referred to as \textbf{agent-environment misalignment}. While prior work has invested substantially in improving agent strategies and environment design, the critical role of the interface still remains underexplored. In this work, we empirically demonstrate that agent-environment misalignment poses a significant bottleneck to agent performance. To mitigate this issue, we propose \textbf{ALIGN}, an \underline{A}uto-A\underline{l}igned \underline{I}nterface \underline{G}e\underline{n}eration framework that alleviates the misalignment by enriching the interface. Specifically, the ALIGN-generated interface enhances both the static information of the environment and the step-wise observations returned to the agent. Implemented as a lightweight wrapper, this interface achieves the alignment without modifying either the agent logic or the environment code. Experiments across multiple domains including embodied tasks, web navigation and tool-use, show consistent performance improvements, with up to a 45.67\% success rate improvement observed in ALFWorld. Meanwhile, ALIGN-generated interface can generalize across different agent architectures and LLM backbones without interface regeneration. Code and experimental results are available at https://github.com/THUNLP-MT/ALIGN.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。