用大模型生成可解释的风险指标,实现零样本检测内部威胁和高级持续攻击
LLMs for Zero-Shot Threat Detection via Structured Risk Indicators

- 分两阶段处理:先生成结构化风险指标,再联合分析时间序列模式
- 在两个数据集上均超越现有最佳方案,最高提升31.50个百分点的F1分数
- 检索增强对弱模型帮助大,强模型无需外部上下文也能表现优异
我们提出一种两阶段大型语言模型(LLM)框架,用于从异构安全日志中实现零样本检测内部威胁和高级持续性威胁(APTs)。该框架将用户行为建模为时间序列,并引入检索增强生成(RAG),从每个用户的过往活动获取个性化行为上下文。不直接从原始日志进行端到端分类,而是先生成可解释的、特定于威胁的风险指标集合,再跨时间窗口联合分类以捕捉跨越多个时段的攻击模式。在两个基准数据集上评估:用于内部威胁检测的CERT r5.2和用于APT检测的PicoDomain,采用四种不同组合的两个开源权重LLM,在有无检索设置下进行测试。所有配置均优于先前最先进基于LLM的框架(GABM),最佳配置在CERT r5.2上提升F1分数11.40个百分点,在PicoDomain上提升31.50个百分点。结果进一步表明,检索主要提升弱模型的性能,使其生成更具区分性的风险指标;而强模型在无检索上下文时仍能达到相近表现。最有效的模型分配策略取决于数据集。这些发现表明,生成风险指标的质量是零样本网络威胁检测性能的主要决定因素。
原文摘要 · Abstract (English)
We propose a two-stage large language model (LLM) framework for zero-shot detection of insider threats and advanced persistent threats (APTs) from heterogeneous security logs. The framework models user activity as chronological timelines and incorporates retrieval-augmented generation (RAG) to provide personalised behavioural context from each user's historical activity. Rather than performing end-to-end classification directly from raw logs, it first generates structured, interpretable sets of threat-specific risk indicators, which are then classified jointly across temporal sequences to capture attack patterns spanning multiple windows.The framework is evaluated on two benchmark datasets, CERT r5.2 for insider threat detection and PicoDomain for APT detection, using four combinations of two open-weight LLMs under both retrieval and non-retrieval settings. All configurations outperform the previous state-of-the-art LLM-based framework (GABM), with the best configuration improving the F1-score by 11.40 percentage points on CERT r5.2 and 31.50 percentage points on PicoDomain. Results further show that retrieval mainly benefits weaker LLMs by generating more discriminative risk indicators, whereas stronger models achieve comparable performance without retrieved context. The most effective assignment of LLMs to the two stages depends on the dataset. These findings show that the quality of the generated risk indicators is the main driver of zero-shot cyber threat detection performance.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。