攻击者通过伪造日志内容诱导大模型误判,暴露安全运维新风险。
Poisoning the Watchtower: Prompt Injection Attacks Against LLM-Augmented Security Operations Through Adversarial Log Content
- 利用日志字段中的恶意指令操控大模型决策,形成四类攻击模式。
- 无防御时96%的摘要任务遭劫持,强防御下仍存11.8%注入成功率。
- 现有模拟方法严重低估攻击风险,尤其对直接覆盖类攻击失准。
大型语言模型正被用作安全运营中心(SOC)中的分析师助手,通过解析日志和告警数据生成分类标签、事件摘要或修复建议。我们研究该设计的结构性缺陷:许多日志字段由攻击者控制,如用户代理、URL、载荷、DNS查询及尝试用户名等,可同时携带入侵证据与对模型的指令。我们称此为‘日志底座提示注入’。提出四类攻击分类:直接覆盖(S1)、身份劫持(S2)、上下文操纵(S3)和混淆载荷(S4)。使用gpt-4o-mini评估48种策略-防御-任务组合。结果发现:直接覆盖在本设置中无效(所有S1分类攻击抑制率为0%);身份劫持在朴素分类器下可抑制68%恶意日志,且在强防御下仍有效;摘要任务风险最高,无防御时上下文操纵成功率高达96%,即使输出受限仍达38%;防御虽降低平均注入成功率(从26.6%降至11.8%),但无法根除风险。此外,对比确定性模拟分析员发现,当前仿真严重误判模型行为,尤其对直接覆盖类攻击。结论表明,SOC协作者应将原始日志视为对抗输入而非普通分析上下文。
原文摘要 · Abstract (English)
Large language models (LLMs) are increasingly used as analyst assistants in security operations centers (SOCs), where they ingest log and alert data to produce triage labels, incident summaries, or remediation advice. We study a structural failure mode of this design: many log fields are attacker controlled. User agents, URLs, payloads, DNS queries, and attempted usernames can therefore carry instructions to the model alongside evidence of the intrusion. We call this setting \emph{log-substrate prompt injection}. We introduce a four-class taxonomy of log-substrate attacks: direct override (S1), persona hijack (S2), context manipulation (S3), and obfuscated payloads (S4). We evaluate 48 strategy-defense-task combinations using \texttt{gpt-4o-mini} as the analyst. Three findings stand out. First, direct overrides are ineffective in our setting: all S1 classification attacks achieve 0\% suppression. In contrast, persona hijacks suppress 68\% of malicious logs under a naive classifier and remain effective under stronger defenses. Second, summarization is the highest-risk task: context manipulation reaches 96\% injection success without defenses and 38\% even with constrained output. Third, defenses reduce but do not eliminate the attack surface: average injection success falls from 26.6\% under naive prompting to 11.8\% under our strongest defense. We also compare empirical results to a deterministic mock analyst and find that simulation substantially mispredicts current model behavior, especially for direct overrides. These results suggest that SOC copilots should treat raw log content as adversarial input rather than ordinary analyst context.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。