arXiv:2511.16590cs.AIcs.CL2025-11AAAI被引 6

构建动态测试框架,评估安卓界面智能体在真实异常下的鲁棒性

D-GARA: A Dynamic Benchmarking Framework for GUI Agent Robustness in Real-World Anomalies

  • 设计动态框架D-GARA,模拟真实场景中的弹窗、提醒等异常
  • 实测顶尖界面代理在异常环境下性能下降超40%
  • 适合研究智能体鲁棒性、人机交互与真实环境测试的学者

开发具备人类级水平操作各类图形用户界面(GUI)的智能体,是迈向通用人工智能的关键一步。然而,现有训练与评估数据集和基准大多静态且理想化,无法反映真实环境中的复杂性与不可预测性,尤其缺乏对异常情况的考量。为填补这一空白,我们提出D-GARA——一个动态基准测试框架,用于评估安卓界面智能体在真实异常环境下的鲁棒性。D-GARA引入了多种实际中常见的异常,包括权限弹窗、电量警告、更新提示等干扰。基于该框架,我们构建并标注了一个包含常用安卓应用及嵌入异常的基准数据集,以支持更广泛的研究。全面实验表明,当暴露于高异常环境时,当前领先级别的界面智能体性能显著下降。D-GARA具有模块化与可扩展性,支持无缝集成新任务、异常类型与交互场景,满足不同评估需求。

原文摘要 · Abstract (English)

Developing intelligent agents capable of operating a wide range of Graphical User Interfaces (GUIs) with human-level proficiency is a key milestone on the path toward Artificial General Intelligence. While most existing datasets and benchmarks for training and evaluating GUI agents are static and idealized, failing to reflect the complexity and unpredictability of real-world environments, particularly the presence of anomalies. To bridge this research gap, we propose D-GARA, a dynamic benchmarking framework, to evaluate Android GUI agent robustness in real-world anomalies. D-GARA introduces a diverse set of real-world anomalies that GUI agents commonly face in practice, including interruptions such as permission dialogs, battery warnings, and update prompts. Based on D-GARA framework, we construct and annotate a benchmark featuring commonly used Android applications with embedded anomalies to support broader community research. Comprehensive experiments and results demonstrate substantial performance degradation in state-of-the-art GUI agents when exposed to anomaly-rich environments, highlighting the need for robustness-aware learning. D-GARA is modular and extensible, supporting the seamless integration of new tasks, anomaly types, and interaction scenarios to meet specific evaluation goals.

GUI智能体鲁棒性评估动态测试安卓异常

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。