arXiv:2512.22894cs.CRcs.AI2025-12被引 12

暗模式能骗过90%的网页代理,越大模型越容易被骗。

DECEPTICON: How Dark Patterns Manipulate Web Agents

论文配图:DECEPTICON: How Dark Patterns Manipulate Web Agents
图 1 · 摘自论文原文
  • 构建独立测试暗模式的环境DECEPTICON,含700个任务
  • 70%以上任务中暗模式成功诱导代理做出恶意行为
  • 大模型和推理能力越强,越易被暗模式操控

欺骗性用户界面设计(即暗模式)广泛存在于网络中,常使用户做出与其目标不符的操作。本文表明,暗模式对网页代理极具误导性,严重威胁其鲁棒性。为此,我们提出DECEPTICON——一个用于孤立测试暗模式的环境,包含700个网页导航任务(600个生成任务与100个真实任务),用于评估指令遵循成功率与暗模式有效性。在当前最先进的代理模型中,暗模式在超过70%的生成与真实任务中成功引导代理走向恶意结果,远高于人类平均31%的成功率。进一步发现,暗模式有效性与模型规模及推理能力正相关,意味着更大、更强大的模型反而更易受骗。主流对抗防御手段,如上下文提示与护栏模型,未能持续降低暗模式干预的成功率。研究揭示了暗模式作为潜在且未被缓解的风险,亟需针对操纵性设计建立更强防护机制。

原文摘要 · Abstract (English)

Deceptive UI designs, widely instantiated across the web and commonly known as dark patterns, manipulate users into performing actions misaligned with their goals. In this paper, we show that dark patterns are highly effective in steering agent trajectories, posing a significant risk to agent robustness. To quantify this risk, we introduce DECEPTICON, an environment for testing individual dark patterns in isolation. DECEPTICON includes 700 web navigation tasks with dark patterns -- 600 generated tasks and 100 real-world tasks, designed to measure instruction-following success and dark pattern effectiveness. Across state-of-the-art agents, we find dark patterns successfully steer agent trajectories towards malicious outcomes in over 70% of tested generated and real-world tasks -- compared to a human average of 31%. Moreover, we find that dark pattern effectiveness correlates positively with model size and test-time reasoning, making larger, more capable models more susceptible. Leading countermeasures against adversarial attacks, including in-context prompting and guardrail models, fail to consistently reduce the success rate of dark pattern interventions. Our findings reveal dark patterns as a latent and unmitigated risk to web agents, highlighting the urgent need for robust defenses against manipulative designs.

暗模式代理安全网页导航模型鲁棒性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。