arXiv:2603.13131cs.AI2026-03

让游戏智能体通过积累经验自我进化,解决长期任务中反复失败的问题。

MineEvolve: Self-Evolution with Accumulated Knowledge for Long-Horizon Embodied Minecraft Agents

  • 将执行过程转化为带类型反馈的可复用行为知识
  • 在多个任务上提升语言模型规划器表现,高依赖任务提升更明显
  • 适合研究长周期具身智能与自进化系统的开发者

长周期具身智能要求智能体通过交互持续改进,而非仅执行静态目标生成的计划。核心挑战在于将过往执行转化为能指导未来决策的知识。Minecraft 提供了典型测试环境,其中制作工具、搭建红石装置、获取钻石装备等任务需长前置链,且常因缺工具、路径阻塞、GUI 失败或执行停滞而中断。为此,我们提出 extbf{MineEvolve},一种基于知识的自进化框架,将执行反馈转化为可行动的行为知识。 extbf{ extcolor{blue}{Monitor}} 将每个子目标执行转换为类型化反馈,包括状态变化、库存变化、失败类型、进度信号和停滞指标。 extbf{ extcolor{blue}{Inducer}} 从成功执行中提取可复用技能,从失败或停滞中提炼修复方案。 extbf{ extcolor{blue}{Curator}} 对知识条目进行验证、合并、过滤与检索, extbf{ extcolor{blue}{Adaptor}} 则利用这些知识修复重复失败或停滞时未完成的计划部分。在 Minecraft MCU 长周期任务套件上的实验表明,MineEvolve 在多个语言模型规划器上持续提升性能,高依赖任务组收益更大。消融实验与知识累积研究进一步证明,将执行信号结构化为行为知识是实现长周期环境中自进化具身智能的有效路径。代码已开源:https://github.com/xzw-ustc/MC-MineEvolve。

原文摘要 · Abstract (English)

Long-horizon embodied intelligence requires agents to improve through interaction, not merely to execute plans generated from static goals. A central challenge is therefore to transform past executions into knowledge that can shape future decisions. Minecraft provides a representative testbed for this problem, where tasks such as crafting tools, building redstone components, and obtaining diamond equipment involve long prerequisite chains and are frequently disrupted by missing tools, blocked paths, GUI failures, or stagnant execution. To this end, we propose \textbf{MineEvolve}, a knowledge-driven self-evolution framework that converts execution feedback into actionable behavioral knowledge. MineEvolve first uses \underline{\emph{\textbf{\ding{182}Monitor}}} to convert each subgoal execution into typed feedback, including state changes, inventory changes, failure types, progress signals, and stagnation indicators. \underline{\emph{\textbf{\ding{183}Inducer}}} then derives reusable skills from successful executions and remedies from failed or stagnant executions. \underline{\emph{\textbf{\ding{184}Curator}}} validates, merges, filters, and retrieves these knowledge entries, while \underline{\emph{\textbf{\ding{185}Adaptor}}} uses them to repair the unfinished part of the plan under repeated failures or stagnation. Experiments on the Minecraft MCU long-horizon task suite show that MineEvolve consistently improves performance across multiple language-model planners, with larger gains on high-dependency task groups. Ablation and knowledge-accumulation studies further demonstrate that converting execution signals into structured behavioral knowledge is an effective path toward self-evolving embodied agents in long-horizon environments. Our code is available at https://github.com/xzw-ustc/MC-MineEvolve.

具身智能自进化Minecraft长周期任务

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。