arXiv:2606.10917cs.AI2026-06被引 3

让大模型同时扮演玩家和环境,自动生成训练任务提升智能体性能

Role-Agent: Bootstrapping LLM Agents via Dual-Role Evolution

论文配图:Role-Agent: Bootstrapping LLM Agents via Dual-Role Evolution
图 1 · 摘自论文原文
  • 大模型自我扮演代理与环境,实现双向反馈协同进化
  • 在多个基准上平均性能超越强基线4%以上
  • 适合想提升智能体自主学习能力的研究者

尽管大型语言模型(LLM)代理在复杂任务中表现出色,但其学习常受限于低效的交互反馈和静态训练环境,制约了泛化能力。为此,本文提出Role-Agent框架,利用单一LLM同时充当代理与环境,实现自举式共演化。该框架包含两个协同组件:世界在代理(WIA)与代理在世界(AIW)。在WIA中,LLM作为代理预测每一步动作后的未来状态,通过预测与实际状态的对齐程度获得过程奖励,促进环境感知推理;在AIW中,LLM分析失败轨迹中的失败模式,并检索具有相似失败特征的任务,从而重构训练数据分布以实现针对性练习。在多个基准上的实验表明,Role-Agent持续提升性能,平均优于强基线4%以上。

原文摘要 · Abstract (English)

Although Large Language Model (LLM) agents have demonstrated strong performance on complex tasks, their learning is often limited by inefficient interaction feedback and static training environments, which hinder broader generalization. To address these limitations, this paper introduces Role-Agent, \textcolor{black}{a framework} that harnesses a single LLM to function concurrently as both the agent and the environment, enabling a bootstrapped co-evolution. Role-Agent comprises two synergistic components: World-In-Agent (WIA) and Agent-In-World (AIW). In WIA, the LLM acts as the agent and predicts future states after each action; the alignment between predicted and actual states is then used as a process reward, encouraging environment-aware reasoning. In AIW, the LLM analyzes failure modes from failed trajectories and retrieves tasks with similar failure patterns, thereby reshaping the training data distribution for targeted practice. Experiments on multiple benchmarks show that Role-Agent consistently improves performance, yielding an average gain of over 4\% over strong baselines.

智能体自举学习大模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。