arXiv:2603.17683cs.AIcs.LG2026-03被引 1

让大模型分步学习游戏规则,32次操作就完成训练,效率提升超50倍。

Sensi: Learn One Thing at a Time -- Curriculum-Based Test-Time Learning for LLM Game Agents

  • 分两阶段设计:感知与行动分离,用外部状态机管理学习进度。
  • 仅用32次动作完成全部学习,比同类系统节省98%交互次数。
  • 适合研究大模型在未知环境中的自适应学习与错误诊断。

部署于未知环境的大语言模型(LLM)代理需在测试时学习任务结构,但现有方法需数千次交互才能形成有效假设。本文提出Sensi,一种针对ARC-AGI-3游戏挑战的LLM代理架构,通过三个机制实现结构化测试时学习:(1)双玩家架构分离感知与行动;(2)由外部状态机管理的课程式学习系统;(3)以数据库为控制平面,实现上下文窗口的程序化调控。此外引入基于动态评估标准的LLM作为裁判,判断何时掌握一个主题并进入下一阶段。实验显示:Sensi v1仅用双玩家架构解决2个关卡;Sensi v2加入课程学习后虽未解出任何关卡,但完成了整个学习课程,仅耗时约32次动作,相较需1600–3000次动作的对比系统实现50–94倍样本效率提升。我们精确诊断失败原因为感知层引发的自我一致幻觉级联,表明瓶颈已从学习效率转向感知根基——这一问题更具可解性。

原文摘要 · Abstract (English)

Large language model (LLM) agents deployed in unknown environments must learn task structure at test time, but current approaches require thousands of interactions to form useful hypotheses. We present Sensi, an LLM agent architecture for the ARC-AGI-3 game-playing challenge that introduces structured test-time learning through three mechanisms: (1) a two-player architecture separating perception from action, (2) a curriculum-based learning system managed by an external state machine, and (3) a database-as-control-plane that makes the agents context window programmatically steerable. We further introduce an LLM-as-judge component with dynamically generated evaluation rubrics to determine when the agent has learned enough about one topic to advance to the next. We report results across two iterations: Sensi v1 solves 2 game levels using the two-player architecture alone, while Sensi v2 adds curriculum learning and solves 0 levels - but completes its entire learning curriculum in approximately 32 action attempts, achieving 50-94x greater sample efficiency than comparable systems that require 1600-3000 attempts. We precisely diagnose the failure mode as a self-consistent hallucination cascade originating in the perception layer, demonstrating that the architectural bottleneck has shifted from learning efficiency to perceptual grounding - a more tractable problem.

大模型游戏代理测试时学习课程学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。