让智能代理只传必要信息,自动隐藏敏感内容。
Minim: Privacy-Aware Minimal View for Agents via Trusted Local Sanitization

- 在本地用双重评分机制判断界面元素是否敏感或必要
- 可减少90%以上无关敏感信息泄露,同时保留关键操作信息
- 适合注重隐私的AI代理系统,尤其在网页自动化场景
当前基于大模型的自主代理依赖丰富的用户界面状态来实现复杂数字环境中的可靠动作定位。然而,许多部署将完整界面状态发送至远程推理服务器,即使大部分元素与当前任务无关,仍可能泄露认证码、私密通知等敏感信息。我们提出MINIM,一个可信的本地中介,在观察数据离开设备前进行隐私感知的最小化处理。基于情境完整性(CI),MINIM通过预测每个界面元素的内在敏感度(s)和任务相关必要性(n),驱动三元披露策略:保留必要元素,抽象敏感属性,移除无关内容。我们优化了面向情境完整的损失函数,对高风险内容更严厉惩罚必要性误判,实现激进裁剪的同时保留任务关键信息。在来自WebArena的真实界面观测实验中,MINIM显著减少了无关敏感信息泄露,同时保持任务关键语义上下文和可靠交互功能。
原文摘要 · Abstract (English)
Modern LLM-powered autonomous agents increasingly rely on rich user interface (UI) state observations to achieve reliable action grounding in complex digital environments. However, many deployments transmit the full UI state to remote inference servers even when most elements are irrelevant to the current task, which can leak sensitive but unnecessary context such as authentication codes, private notifications, and background application states. We propose MINIM, a trusted local broker that performs privacy-aware minimization on the client side before any observation leaves the device. Grounded in Contextual Integrity (CI), MINIM learns a dual-score representation for each UI element by predicting an inherent sensitivity score (s) and a task-conditioned necessity score (n). These scores drive a ternary disclosure policy that keeps essential elements, abstracts sensitive attributes when needed, and removes task-irrelevant content. We optimize a CI-aware objective that penalizes necessity errors more strongly on high-risk content, enabling aggressive pruning while preserving task-critical information. Experiments on real-world UI observations derived from WebArena show that MINIM substantially reduces task-irrelevant sensitive leakage while preserving task-critical semantic context and the interactive affordances required for reliable agent actions.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。