提出新框架提升长周期任务智能体的可靠性和成功率
LongHorizon-Harness: Advancing Long-Horizon Agents for Real-World Tasks

- 将任务状态独立管理,通过验证机制避免错误传递
- 在多个基准上性能显著提升,最高达80.7%
- 适配多种模型与系统,适用于真实场景长流程任务
大型语言模型智能体越来越多地承担需要持续推理、工具使用和多步修正的长周期任务。然而,现有智能体框架将任务执行、状态跟踪和完成评估都纳入不断增长的上下文,导致状态难以追踪,且错误自我评估会传播至后续决策。本文将长周期执行重构为任务状态管理问题,提出LongHorizon-Harness,将任务状态显式保存在执行之外,并仅通过环境独立验证的事实更新状态。其管理-执行-审计(MEA)循环由管理者维护任务状态并决定下一步子任务,用无上下文重置的执行器完成任务,再由只读审计器验证环境状态后进入下一轮。轻量级AgentAdapter支持在不修改原智能体逻辑的前提下替换模型与框架后端。实验显示,该框架将Qwen 3.7-Plus在WeaveBench上表现从51.8%提升至80.7%,在Terminal-Bench 2.1上从69.7%提升至77.2%,在OSWorld 2.0上从2.8%提升至8.3%;同时使Claude Opus 4.7在OSWorld 2.0子集上从20.0%提升至34.3%,表明其在不同模型、框架和交互领域均具稳定增益。
原文摘要 · Abstract (English)
Large language model (LLM) agents increasingly undertake long-horizon tasks that require sustained reasoning, tool use, and revision across many interdependent steps. However, existing agent harnesses maintain task execution, task state, and completion assessment within a growing context, making the state difficult to track and allowing incorrect self-assessments to propagate into later decisions. We reformulate long-horizon execution as a task-state management problem and propose LongHorizon-Harness, which maintains the task state explicitly outside execution and updates it only with facts independently verified from the environment. Its Manage-Execute-Audit(MEA) loop uses a manager to maintain the task state and determine the next subtask, a fresh-context executor to perform it, and a read-only auditor to verify the resulting environment state before the next round. A lightweight AgentAdapter supports interchangeable model and harness backends without modifying their native agent loops. LongHorizon-Harness improves Qwen~3.7-Plus from 51.8% to 80.7% on WeaveBench, from 69.7% to 77.2% on Terminal-Bench~2.1, and from 2.8% to 8.3% on OSWorld~2.0. It also raises Claude Opus~4.7 from 20.0% to 34.3% on an OSWorld2.0 subset, demonstrating consistent gains across models, harnesses, and interaction domains.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。