arXiv:2410.21060cs.CRcs.AI2024-10中稿 · 2025 IEEE European…被引 38

用大模型自动构建网络安全知识图谱,无需大量标注数据。

CTINexus: Automatic Cyber Threat Intelligence Knowledge Graph Construction Using Large Language Models

  • 基于优化的上下文学习自动构造提示,高效提取威胁实体与关系。
  • 在150篇真实报告上构建知识图谱,准确率和完整性显著优于现有方法。
  • 适合安全团队快速分析新威胁,尤其适用于资源有限的机构。

网络安全威胁情报(CTI)报告中的文本包含丰富的威胁知识,对组织应对快速演变的网络威胁至关重要。然而,现有知识抽取方法灵活性与泛化能力不足,常导致信息不全或错误:语法解析依赖固定规则和词典,模型微调则需大量标注数据,难以适应新威胁和新本体。为此,我们提出CTINexus,一种利用大语言模型(LLM)优化上下文学习(ICL)的新型框架,实现数据高效、高质量的网络安全知识图谱(CSKG)构建。该框架无需大量数据或参数调优,可仅用少量标注样本适配多种本体。核心包括:(1) 设计自动提示生成策略与最优示例检索,以提取多样化网络安全实体与关系;(2) 层次化实体对齐技术,规范化知识并消除冗余;(3) 长距离关系预测机制,补全缺失连接。基于10个平台收集的150份真实CTI报告的广泛评估表明,CTINexus在构建准确且完整的CSKG方面显著优于现有方法,展现出在动态威胁环境中变革性提升威胁情报分析效率的潜力。

原文摘要 · Abstract (English)

Textual descriptions in cyber threat intelligence (CTI) reports, such as security articles and news, are rich sources of knowledge about cyber threats, crucial for organizations to stay informed about the rapidly evolving threat landscape. However, current CTI knowledge extraction methods lack flexibility and generalizability, often resulting in inaccurate and incomplete knowledge extraction. Syntax parsing relies on fixed rules and dictionaries, while model fine-tuning requires large annotated datasets, making both paradigms challenging to adapt to new threats and ontologies. To bridge the gap, we propose CTINexus, a novel framework leveraging optimized in-context learning (ICL) of large language models (LLMs) for data-efficient CTI knowledge extraction and high-quality cybersecurity knowledge graph (CSKG) construction. Unlike existing methods, CTINexus requires neither extensive data nor parameter tuning and can adapt to various ontologies with minimal annotated examples. This is achieved through: (1) a carefully designed automatic prompt construction strategy with optimal demonstration retrieval for extracting a wide range of cybersecurity entities and relations; (2) a hierarchical entity alignment technique that canonicalizes the extracted knowledge and removes redundancy; (3) an long-distance relation prediction technique to further complete the CSKG with missing links. Our extensive evaluations using 150 real-world CTI reports collected from 10 platforms demonstrate that CTINexus significantly outperforms existing methods in constructing accurate and complete CSKG, highlighting its potential to transform CTI analysis with an efficient and adaptable solution for the dynamic threat landscape.

知识图谱威胁情报大模型自动化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。