通过自适应探索优化提升GUI理解中语义对齐能力
InfiGUI-G1: Advancing GUI Grounding with Adaptive Exploration Policy Optimization
- 引入多答案生成与自适应奖励函数,增强模型探索效率
- 在多个基准上实现最高9.0%的相对提升,显著改善泛化能力
- 适合研究GUI智能代理、多模态大模型应用的开发者
多模态大语言模型(MLLM)推动了仅依赖视觉输入操作图形用户界面(GUI)的自主代理发展。核心挑战在于自然语言指令的鲁棒性定位,需实现精确的空间对齐(准确定位元素坐标)和关键的语义对齐(将指令正确匹配到功能合适的UI元素)。尽管可验证奖励强化学习(RLVR)在改善空间对齐方面有效,但我们发现低效探索制约了语义对齐,阻碍模型学习复杂语义关联。为此,提出自适应探索策略优化(AEPO)框架,采用多答案生成策略促进更广范围探索,并基于效率η=U/C的理论基础设计自适应探索奖励(AER)。经AEPO训练的InfiGUI-G1-3B与InfiGUI-G1-7B模型,在多个具挑战性的GUI定位基准上达到新最优,相比原始RLVR基线在测试泛化与语义理解的基准上实现最高9.0%的相对提升。资源见https://github.com/InfiXAI/InfiGUI-G1。
原文摘要 · Abstract (English)
The emergence of Multimodal Large Language Models (MLLMs) has propelled the development of autonomous agents that operate on Graphical User Interfaces (GUIs) using pure visual input. A fundamental challenge is robustly grounding natural language instructions. This requires a precise spatial alignment, which accurately locates the coordinates of each element, and, more critically, a correct semantic alignment, which matches the instructions to the functionally appropriate UI element. Although Reinforcement Learning with Verifiable Rewards (RLVR) has proven to be effective at improving spatial alignment for these MLLMs, we find that inefficient exploration bottlenecks semantic alignment, which prevent models from learning difficult semantic associations. To address this exploration problem, we present Adaptive Exploration Policy Optimization (AEPO), a new policy optimization framework. AEPO employs a multi-answer generation strategy to enforce broader exploration, which is then guided by a theoretically grounded Adaptive Exploration Reward (AER) function derived from first principles of efficiency eta=U/C. Our AEPO-trained models, InfiGUI-G1-3B and InfiGUI-G1-7B, establish new state-of-the-art results across multiple challenging GUI grounding benchmarks, achieving significant relative improvements of up to 9.0% against the naive RLVR baseline on benchmarks designed to test generalization and semantic understanding. Resources are available at https://github.com/InfiXAI/InfiGUI-G1.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。