用分层控制器让游戏智能体省钱省时,长程任务更稳更准。
SPIKE: An Adaptive Dual Controller Framework for Cost-Efficient Long-Horizon Game Agents

- 双控架构:战略控制器低频规划,反应控制器极速执行。
- 事件触发切换控制,成功率达38.5%,令牌消耗减少54.9%。
- 适合资源受限的长周期游戏任务,提升稳定性和恢复能力。
开放世界游戏中,长周期多模态智能体需在严格令牌与延迟预算下保持目标导向。现有方法常在高成本逐步推理与易漂移、重复失败的反应式执行间权衡。本文提出SPIKE,一种自适应双控制器框架,通过在局部稳定段复用战略推理,并在事件边界重新调用,实现高效长程控制。其战略控制器负责低频全局规划、故障分析与恢复,反应控制器则在严格令牌限制下处理快速局部执行。事件触发器监测视觉变化、任务进展、重复动作与失败信号,判断是否维持反应或升级至战略推理。层级记忆将短期经验存于状态-动作记忆库(SA-MB),结构化证据存于状态-动作知识图谱(SA-KG),使各控制器获取所需上下文。该设计实现战略方案跨多个反应步骤复用,支持计划过期时的本地覆盖,并仅在必要时启用昂贵推理。在StarDojo的Lite-100数据集上,SPIKE相较最强基线提升成功率5.0个百分点(相对提升38.5%),预算约束成功率提升9.3点(相对提升75.6%),令牌消耗降低54.9%,延迟减少40.8%。消融实验表明,事件触发、反应覆盖与异构记忆均对成功与恢复有贡献,验证了选择性推理的有效性。
原文摘要 · Abstract (English)
Long-horizon multimodal agents in open-world games must stay goal-directed across many low-level interactions under tight token and latency budgets. Existing approaches often trade off costly per-step reasoning against reactive execution that can drift, repeat failures, and recover poorly. Our key idea is to reuse strategic reasoning across locally stable segments and reinvoke it at event boundaries. We present SPIKE, an adaptive dual controller framework for cost-efficient long-horizon game control. Its Strategic Controller performs low-frequency global planning, failure analysis, and recovery, while its Reactive Controller handles fast local execution under a strict token budget. An Event Trigger monitors visual change, task progress, repeated actions, and failure signals to decide when control should stay reactive or escalate to strategic reasoning. Hierarchical Memory separates short-term experience reuse in the State-Action Memory Bank (SA-MB) from structured evidence in the State Action Knowledge Graph (SA-KG), allowing each controller to retrieve the context it needs. This design reuses strategic proposals over multiple reactive steps, supports local override when plans become stale, and reserves expensive reasoning for moments where extra deliberation is useful. On the Lite-100 split of StarDojo, SPIKE improves Lite-100 success rate (SR) by 5.0 percentage points (38.5% relative) over the strongest Lite-100 baseline and Budgeted SR by 9.3 points (75.6% relative) over the strongest budgeted baseline. It also reduces token consumption by 54.9% and latency by 40.8%. Ablations show that event triggering, reactive override, and heterogeneous memory each contribute to success and recovery, supporting selective reasoning rather than reasoning at every step.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。