arXiv:2607.18659cs.CRcs.AI2026-07

LLM代理可轻松突破主流验证码防御,暴露安全体系漏洞。

Broken Gates: Re-evaluating Web Bot Defenses in the Age of LLM Agents

论文配图:Broken Gates: Re-evaluating Web Bot Defenses in the Age of LLM Agents
图 1 · 摘自论文原文
  • 用大模型代理模拟真实用户行为,测试防御系统
  • 商业解码服务几乎零成本破解挑战式验证码
  • 非交互防御的成败取决于运行环境真实性

基于大模型的浏览器代理正重塑网络安全部署格局。与传统自动化脚本不同,这些代理能自主导航网页、理解页面内容并以自然语言指令交互。本文系统评估了两类防御机制对两类攻击者(商业验证码解码服务和大模型代理)的鲁棒性。实验涵盖7个解码服务和6个代理(含云端、自托管、AI辅助及浏览器插件),针对hCaptcha、reCaptcha v2、reCaptcha v3和Cloudflare Turnstile进行测试。结果表明:挑战类防御对商业解码服务普遍失效,可近乎零成本绕过;当具备专用求解模块时,大模型代理也能成功突破。非交互式防御如reCaptcha v3更具抵抗力,但细粒度交互追踪显示,行为几乎相同的两个代理却一通一阻,根本差异在于执行环境的真实性而非行为本身。这说明非交互防御的安全边界在环境层,对防御系统的设计与评估具有深远影响。

原文摘要 · Abstract (English)

LLM-based browser agents are rapidly changing the threat landscape for web security. Unlike traditional automation frameworks that execute predefined scripts, these agents can autonomously navigate websites, reason about page content, and interact with web interfaces using natural-language instructions. This evolution raises fundamental questions about the effectiveness of bot management systems, widely deployed to defend against automated web abuse. In this paper, we present a systematic measurement study evaluating the resilience of both interactive challenge-based defenses and non-interactive trust-based defenses against two attacker classes: commercial Captcha-solving services and LLM-based browser agents. Our evaluation spans seven solver services and six agents, including cloud-hosted, self-hosted, AI-assisted, and browser-extension configurations, tested against hCaptcha, reCaptcha v2, reCaptcha v3, and Cloudflare Turnstile. Our results show that challenge-based defenses are broadly ineffective against commercial solvers, which achieve near-perfect bypass at negligible cost. The challenges can similarly be defeated by LLM-based agents when a dedicated solver module is available. Non-interactive defenses such as reCaptcha v3 exhibit stronger resistance, but our analysis reveals that this resilience does not reflect a fundamental security property. Through fine-grained interaction trace analysis, we find that two agents with nearly indistinguishable behavioral footprints yield divergent outcomes, one bypassing the defense and one failing, isolating execution-environment authenticity, rather than agent behavior, as the determining factor. These findings suggest that the security boundary of non-interactive defenses lies at the environment layer, with significant implications for how bot management systems are designed and evaluated.

Web安全LLM代理验证码破解环境可信

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。