arXiv:2505.11547cs.CRcs.AI2025-05被引 3

用大模型自动识别攻击手法,加速黑客溯源。

On Technique Identification and Threat-Actor Attribution using LLMs and Embedding Models

  • 用大模型从安全报告中提取攻击行为特征
  • 生成的特征虽有噪声但频率与真实数据接近
  • 可训练模型实现高于基线的攻击者预测

网络攻击溯源仍是网络安全中的关键难题。当前依赖人工从密集的取证文档中提取行为指标,导致溯源延迟,尤其在国际级事件后更为显著。本研究评估了大语言模型(LLMs)在基于取证文档提取的行为指标上进行攻击者溯源的能力。我们测试了OpenAI的GPT-4和text-embedding-3-large模型,通过比较模型生成的战术、技术与程序(TTPs)与MITRE ATT&CK小组的人工标注数据来评估效果。框架利用向量嵌入搜索从文本中提取TTP,并构建攻击者画像,供机器学习模型学习。主要贡献包括:(1)评估现成大模型在TTP提取与溯源中的表现;(2)建立从原始威胁情报文档到攻击者预测的端到端流程。研究发现,标准大模型生成的TTP数据存在噪声,与人工标注数据相似度较低,但其出现频率与现有MITRE数据一致。尽管生成的TTP与人工结果不同,仍能有效训练模型,在溯源任务中表现优于基线。项目代码与文件见:https://github.com/kylag/ttp_attribution。

原文摘要 · Abstract (English)

Attribution of cyber-attacks remains a complex but critical challenge for cyber defenders. Currently, manual extraction of behavioral indicators from dense forensic documentation causes significant attribution delays, especially following major incidents at the international scale. This research evaluates large language models (LLMs) for cyber-attack attribution based on behavioral indicators extracted from forensic documentation. We test OpenAI's GPT-4 and text-embedding-3-large for identifying threat actors' tactics, techniques, and procedures (TTPs) by comparing LLM-generated TTPs against human-generated data from MITRE ATT&CK Groups. Our framework then identifies TTPs from text using vector embedding search and builds profiles to attribute new attacks for a machine learning model to learn. Key contributions include: (1) assessing off-the-shelf LLMs for TTP extraction and attribution, and (2) developing an end-to-end pipeline from raw CTI documents to threat-actor prediction. This research finds that standard LLMs generate TTP datasets with noise, resulting in a low similarity to human-generated datasets. However, the TTPs generated are similar in frequency to those within the existing MITRE datasets. Additionally, although these TTPs are different than human-generated datasets, our work demonstrates that they still prove useful for training a model that performs above baseline on attribution. Project code and files are contained here: https://github.com/kylag/ttp_attribution.

攻击溯源大模型TTP提取

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。