arXiv:2605.07505cs.AIcs.LG2026-05被引 2

用强化学习蒸馏小模型,让手机端界面自动化更准更快

LiteGUI: Distilling Compact GUI Agents with Reinforcement Learning

论文配图:LiteGUI: Distilling Compact GUI Agents with Reinforcement Learning
图 1 · 摘自论文原文
  • 不依赖监督微调,通过策略蒸馏提升小模型性能
  • 在多个基准上超越同类轻量模型,接近大模型表现
  • 适合资源受限场景的智能交互系统研发者

开发轻量级、本地运行的视觉语言界面智能体对跨平台自动化交互至关重要。当前本地模型受制于容量限制,性能提升亟待突破。传统监督微调易导致过拟合、灾难性遗忘和策略僵化,难以应对挑战。本文提出无监督微调的训练范式,首次系统引入广义知识蒸馏至界面智能体领域,通过引导式在线策略蒸馏结合专家轨迹与动态检索机制,降低幻觉并缓解多解任务中的认知错配。进一步提出多解双层GRPO框架,联合优化高层子任务规划与底层执行匹配,增强长序列任务探索能力。构建自动化数据生成流水线,合成带丰富多解标注的界面任务轨迹。大量实验表明,本方法在轻量模型中达到顶尖水平,性能媲美大幅模型。消融研究证实,结构化在线蒸馏与多解双层探索可充分释放2B/3B规模智能体潜力,突破传统模仿学习性能瓶颈。

原文摘要 · Abstract (English)

Developing lightweight, on-device vision-language GUI agents is essential for efficient cross-platform automated interaction. However, current on-device agents are constrained by limited model capacity, and further performance improvements remain urgently needed. Traditional Supervised Fine-Tuning (SFT) for small-scale models often leads to overfitting, catastrophic forgetting and policy rigidity, and thus fails to fully address these challenges. In this work, we propose a novel SFT-free training paradigm that significantly enhances the performance of small-scale models. We first present the initial systematic integration of generalized knowledge distillation into the GUI agent domain via Guided On-policy Distillation. By incorporating oracle reference trajectories together with a dynamic retrieval mechanism, our method reduces hallucinations and mitigates the cognitive misalignment inherent in multi-solution GUI tasks. Building on this foundation, we further introduce a Multi-solution Dual-level GRPO framework that jointly aligns macro-level subtask planning with micro-level execution matching, thereby improving exploration in long-horizon GUI agent scenarios. In addition, we construct an automated data generation pipeline to synthesize GUI task trajectories with rich multi-solution annotations. Extensive experiments show that our method achieves state-of-the-art performance among lightweight models while remaining competitive with substantially larger-scale models across all benchmarks. Ablation studies further demonstrate that structured on-policy distillation and multi-solution dual-level exploration can fully unlock the capabilities of 2B/3B scale agents, surpassing the performance limits of conventional imitation learning.

GUI智能体轻量化模型强化学习知识蒸馏

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。