arXiv:2601.02371cs.CYcs.AI2026-01被引 4

为网页智能代理设计可读写的权限清单,让网站自主控制交互行为。

Permission Manifests for Web Agents

  • 引入 agent-permissions.json 文件,类似 robots.txt 的轻量级规则声明
  • 支持网站指定允许的代理操作,避免全盘封禁或验证码阻拦
  • 适合关注自动化合规、无障碍访问与电商服务优化的研究者与开发者

基于大语言模型的网页智能代理正在改变人机交互方式。与传统爬虫不同,现代代理能复杂导航、结构化提取信息并完成端到端任务,但现有治理机制无法应对这些能力。缺乏明确交互权限规范,网站只能采取全盘封锁或验证码策略,损害了自动化、电商便利性及辅助工具等有益应用。本文提出 agent-permissions.json,一种类似 robots.txt 的轻量级权限清单,网站可声明允许的交互行为,辅以可用的 API 参考。该框架实现低门槛协作:网站仅需编写简单 JSON 文件,代理即可自动解析执行。网站由此可聚焦于阻止违规代理,而非全面禁止所有代理。该机制延续 robots.txt 的精神,结合 AIPref 等数据使用倡议,构建尊重网站意愿且促进有益代理交互的合规体系。

原文摘要 · Abstract (English)

The rise of Large Language Model (LLM)-based web agents represents a significant shift in automated interactions with the web. Unlike traditional crawlers that follow simple conventions, such as robots$.$txt, modern agents engage with websites in sophisticated ways: navigating complex interfaces, extracting structured information, and completing end-to-end tasks. Existing governance mechanisms were not designed for these capabilities. Without a way to specify what interactions are and are not allowed, website owners increasingly rely on blanket blocking and CAPTCHAs, which undermine beneficial applications such as efficient automation, convenient use of e-commerce services, and accessibility tools. We introduce agent-permissions$.$json, a robots$.$txt-style lightweight manifest where websites specify allowed interactions, complemented by API references where available. This framework provides a low-friction coordination mechanism: website owners only need to write a simple JSON file, while agents can easily parse and automatically implement the manifest's provisions. Website owners can then focus on blocking non-compliant agents, rather than agents as a whole. By extending the spirit of robots$.$txt to the era of LLM-mediated interaction, and complementing data use initiatives such as AIPref, the manifest establishes a compliance framework that enables beneficial agent interactions while respecting site owners' preferences.

智能代理权限控制网页自动化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。