让GUI智能体学会精准用历史信息,提升导航效率与准确率。
HiconAgent: History Context-aware Policy Optimization for GUI Agents
- 动态采样+锚点压缩,智能筛选有用历史
- 小模型比大模型高8.46%准确率,速度快2.47倍
- 适合追求高效智能体的开发者和研究者
图形用户界面(GUI)智能体需有效利用历史上下文完成序列化导航任务。单纯使用完整历史会带来计算开销大、无关信息干扰等问题。为此,我们提出HiconAgent,基于历史感知策略优化(HCPO)实现高效的历史信息利用。HCPO包含两个互补组件:(1) 动态上下文采样(DCS)在采样阶段采用可变长度历史,使智能体自适应选择相关上下文;(2) 锚点引导的历史压缩(AHC)在策略更新阶段采用双分支结构,压缩分支移除历史观测但保留历史动作作为信息锚点,通过增强对齐损失使两分支保持一致。在主流GUI导航基准上测试表明:尽管更小,HiconAgent-3B在GUI-Odyssey上比GUI-R1-7B高出8.46%的定位准确率和11.32%的步数成功率,同时在AndroidControl和AITW上表现相当,计算速度提升2.47倍,浮点运算量减少60%。
原文摘要 · Abstract (English)
Graphical User Interface (GUI) agents require effective use of historical context to perform sequential navigation tasks. While incorporating past actions and observations can improve decision making, naive use of full history leads to excessive computational overhead and distraction from irrelevant information. To address this, we introduce HiconAgent, a GUI agent trained with History Context-aware Policy Optimization (HCPO) for efficient and effective utilization of historical information. HCPO optimizes history usage in both sampling and policy updates through two complementary components: (1) Dynamic Context Sampling (DCS) presents the agent with variable length histories during sampling, enabling adaptive use of the most relevant context; (2) Anchor-guided History Compression (AHC) refines the policy update phase with a dual branch strategy where the compressed branch removes history observations while keeping history actions as information flow anchors. The compressed and uncompressed branches are coupled through a history-enhanced alignment loss to enforce consistent history usage while maintaining efficiency. Experiments on mainstream GUI navigation benchmarks demonstrate strong performance. Despite being smaller, HiconAgent-3B outperforms GUI-R1-7B by +8.46 percent grounding accuracy and +11.32 percent step success rate on GUI-Odyssey, while achieving comparable results on AndroidControl and AITW with up to 2.47x computational speedup and 60 percent FLOPs reduction.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。