arXiv:2606.20910cs.CRcs.AI2026-06

用多层指纹识别AI网页代理,97%准确率区分其与人类和传统爬虫。

Whose Agent Are You? Multi-Layer Fingerprinting and Attribution of Autonomous Web Agents

论文配图:Whose Agent Are You? Multi-Layer Fingerprinting and Attribution of Autonomous Web Agents
图 1 · 摘自论文原文
  • 通过网络层和浏览器行为构建多层指纹特征
  • 在6大代理框架中实现97%识别准确率
  • 适合关注网站安全与内容防护的开发者

随着人工智能网页代理(结合大语言模型与浏览器级控制)日益普及,未经许可的内容抓取已成为隐私与安全挑战。现有防御手段如robots.txt和主动反爬机制效果有限,常被规避。本文提出一种基于网络层特征(如TLS、HTTP)与浏览器交互行为的多层指纹机制,可有效区分AI代理与人类及传统爬虫。我们实现了一个可部署于真实站点的程序化日志框架,分析六种主流代理框架(AutoGen、Browser Use、Claude、Gemini、Operator、Skyvern),发现其在构造HTTP请求、建立TLS/HTTP连接及执行自主浏览器操作时存在潜在结构差异。将这些多层特征输入决策树分类器,系统实现97%高精度识别,成功分离不同代理架构,并区分代理流量与人类浏览及旧式爬虫。结果表明,跨层代理追踪是一种抗规避、鲁棒性强的内容保护与网络安全策略。

原文摘要 · Abstract (English)

As AI web agents proliferate, combining large language models with autonomous, browser-level control, indiscriminate content scraping by web agents has emerged as a privacy and security challenge. Existing defenses, such as robots.txt and active bot-blocking, are insufficient, as they are widely violated and easily circumvented. In this work, we demonstrate that AI web agents can be effectively distinguished from humans and traditional crawlers using a multi-layer fingerprint based on both network layer characteristics (e.g., TLS, HTTP) and browser interaction behavior. We implement this mechanism as a programmatic logging framework that can be deployed on a live, instrumented domain. By analyzing six prominent agent frameworks (AutoGen, Browser Use, Claude, Gemini, Operator, and Skyvern), we uncover latent structural differences in how these systems assemble HTTP requests, establish TLS/HTTP connections, and execute autonomous browser actions. Feeding these multi-layer features into a decision tree classifier, our framework achieves high-fidelity identification (97% accuracy), successfully isolating distinct agent architectures and differentiating agent traffic from both human browsing baselines and legacy crawlers. Our findings demonstrate that cross-layer agent tracking provides a robust, evasion-resistant strategy for content protection and web security policy enforcement.

AI代理指纹识别网络安全内容防护

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。