用程序结构管理交互历史,让安卓代理长期任务更稳定
AgentProg: Empowering Long-Horizon GUI Agents with Program-Guided Context Management
- 将操作历史转化为带变量和流程的程序,智能决定存留信息
- 在AndroidWorld上成功率达92.3%,长任务下性能远超基线
- 适合做复杂、长时间的自动化安卓操作,如多步骤应用任务
移动GUI代理的快速发展推动了长周期任务自动化的研究。然而,构建此类代理面临关键瓶颈:不断增长的交互历史带来巨大上下文开销。现有上下文管理和压缩方法常丢失关键语义信息,导致任务性能下降。我们提出AgentProg,一种基于程序引导的上下文管理方法,将交互历史重构为包含变量与控制流的程序。通过程序结构组织信息,提供可解释的保留与丢弃机制。进一步引入受信念MDP框架启发的全局信念状态机制,应对部分可观测性并适应环境突变。在AndroidWorld及我们扩展的长周期任务数据集上的实验表明,AgentProg在这些基准上达到当前最优成功率。更重要的是,在长周期任务中保持稳定表现,而基线方法出现灾难性退化。系统已开源:https://github.com/MobileLLM/AgentProg。
原文摘要 · Abstract (English)
The rapid development of mobile GUI agents has stimulated growing research interest in long-horizon task automation. However, building agents for these tasks faces a critical bottleneck: the reliance on ever-expanding interaction history incurs substantial context overhead. Existing context management and compression techniques often fail to preserve vital semantic information, leading to degraded task performance. We propose AgentProg, a program-guided approach for agent context management that reframes the interaction history as a program with variables and control flow. By organizing information according to the structure of program, this structure provides a principled mechanism to determine which information should be retained and which can be discarded. We further integrate a global belief state mechanism inspired by Belief MDP framework to handle partial observability and adapt to unexpected environmental changes. Experiments on AndroidWorld and our extended long-horizon task suite demonstrate that AgentProg has achieved the state-of-the-art success rates on these benchmarks. More importantly, it maintains robust performance on long-horizon tasks while baseline methods experience catastrophic degradation. Our system is open-sourced at https://github.com/MobileLLM/AgentProg.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。