为大模型代理设计低延迟欺诈检测层,识别渐进式攻击行为。
A Low-Latency Fraud Detection Layer for Detecting Adversarial Interaction Patterns in LLM-Powered Agents

- 基于交互轨迹建模风险,融合提示、工具使用等多维特征。
- 相比大模型检测器提速9倍以上,12000次交互测试准确率高。
- 适合部署在需实时防御的自动化代理系统中。
大语言模型(LLM)驱动的智能体在自主任务执行、工具调用和多步推理方面表现出强大能力,但其日益增强的自主性也带来了新攻击面:恶意交互可通过直接提示注入、间接内容攻击及多轮升级策略操控智能体行为。现有防御策略主要依赖提示级过滤和规则护栏,但在风险随交互序列逐步显现时往往失效。本文提出一种互补性防御机制——低延迟欺诈检测层,用于识别LLM驱动智能体中的对抗性交互模式。该方法不判断单个提示是否恶意,而是通过结构化运行时特征(包括提示特性、会话动态、工具使用、执行上下文及欺诈信号)对交互轨迹建模风险。检测层可采用轻量级模型实现,支持低延迟实时部署。为评估框架,我们构建了由参数化模板生成的12000条多轮智能体交互合成语料库,模拟真实智能体工作流。利用42个结构化特征与XGBoost分类器,检测器速度超过基于LLM的检测器9倍以上。实验与消融研究表明,交互级行为检测应成为部署阶段防御的核心组件。
原文摘要 · Abstract (English)
Large Language Model (LLM)-powered agents demonstrate strong capabilities in autonomous task execution, tool use, and multi-step reasoning. However, their increasing autonomy also introduces a new attack surface: adversarial interactions can manipulate agent behavior through direct prompt injection, indirect content attacks, and multi-turn escalation strategies. Existing defense strategies focus on prompt-level filtering and rule-based guardrails, which are often insufficient when risk emerges gradually across interaction sequences. In this work, we propose a complementary defense mechanism: a low-latency fraud detection layer for detecting adversarial interaction patterns in LLM-powered agents. Instead of determining whether a single prompt is malicious, our approach models risk over interaction trajectories using structured runtime features derived from prompt characteristics, session dynamics, tool usage, execution context, and fraud-inspired signals. The detection layer can be implemented using lightweight models leading to low-latency real-time deployments. To evaluate the framework, we construct a synthetic corpus of 12,000 multi-turn agent interactions generated from parameterized templates that simulate realistic agentic workflows. Using 42 structured features and an XGBoost classifier, our detector achieves over 9 times faster than LLM-based detectors. Through the experiment and ablation studies, our work suggests that interaction-level behavioral detection should become a core component of deployment-time defense for LLM-powered agents.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。