arXiv:2604.09155cs.LGcs.AI2026-04被引 4

提出可控制风险的GUI自动化框架,防止有害操作。

CORA: Conformal Risk-Controlled Agents for Safeguarded Mobile GUI Automation

  • 用守护模型评估每步操作的风险,动态决定执行或放弃。
  • 在真实场景中将有害操作率降至1.2%,同时减少用户干扰。
  • 适合需要高安全性的自动手机操作场景,如金融应用。

由视觉语言模型驱动的图形界面代理正从被动辅助转向自主操作,但其无约束的动作空间可能带来严重且不可逆的财务、隐私或社交损害。现有防护手段依赖提示工程、脆弱启发式规则以及VLM作为评判者,缺乏形式化验证和用户可调保证。本文提出CORA(COnformal Risk-controlled GUI Agent),一种后策略、前动作的安全防护框架,提供对有害执行动作的统计保障。CORA将安全重新定义为选择性动作执行:训练一个守护模型以估计每个提议步骤的动作条件风险。不直接设定原始分数阈值,而是利用同形风险控制校准执行/放弃边界,满足用户指定的风险预算,并将被拒绝的动作路由至可训练的诊断模型,该模型通过多模态推理分析被拒动作,推荐干预措施(如确认、反思或终止)以最小化用户负担。目标锁定机制锚定评估于明确冻结的用户意图,抵抗视觉注入攻击。为严格评估该范式,我们引入Phone-Harm,一个包含真实世界设置下逐步危害标签的新移动安全违规基准。在Phone-Harm及公开基准上对多种基线的实验表明,CORA提升了安全-帮助性-中断的帕累托前沿,提供了可实践、统计基础坚实的安全范式用于自主GUI执行。代码与基准可在cora-agent.github.io获取。

原文摘要 · Abstract (English)

Graphical user interface (GUI) agents powered by vision language models (VLMs) are rapidly moving from passive assistance to autonomous operation. However, this unrestricted action space exposes users to severe and irreversible financial, privacy or social harm. Existing safeguards rely on prompt engineering, brittle heuristics and VLM-as-critic lack formal verification and user-tunable guarantees. We propose CORA (COnformal Risk-controlled GUI Agent), a post-policy, pre-action safeguarding framework that provides statistical guarantees on harmful executed actions. CORA reformulates safety as selective action execution: we train a Guardian model to estimate action-conditional risk for each proposed step. Rather than thresholding raw scores, we leverage Conformal Risk Control to calibrate an execute/abstain boundary that satisfies a user-specified risk budget and route rejected actions to a trainable Diagnostician model, which performs multimodal reasoning over rejected actions to recommend interventions (e.g., confirm, reflect, or abort) to minimize user burden. A Goal-Lock mechanism anchors assessment to a clarified, frozen user intent to resist visual injection attacks. To rigorously evaluate this paradigm, we introduce Phone-Harm, a new benchmark of mobile safety violations with step-level harm labels under real-world settings. Experiments on Phone-Harm and public benchmarks against diverse baselines validate that CORA improves the safety--helpfulness--interruption Pareto frontier, offering a practical, statistically grounded safety paradigm for autonomous GUI execution. Code and benchmark are available at cora-agent.github.io.

GUI自动化安全防护风险控制视觉语言模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。