用自省机制自动生成并验证网络安全规则,提升威胁情报落地效率。
FALCON: Transforming Cyber Threat Intelligence into Deployable IDS Rules with Self-Reflection
- 构建语义评分器,量化威胁情报与规则的功能匹配度。
- 在真实数据集上实现0.72平均相关性,分析师一致性达84%。
- 无需真实标签即可验证规则,适合安全自动化研发人员。
基于签名的入侵检测系统(IDS)通过匹配网络或主机事件与预定义规则来发现恶意行为。安全分析师需从网络威胁情报(CTI)手动创建这些规则。随着威胁演变,这一人工流程面临两大瓶颈:在编写新规则前,分析师需将新收到的CTI与现有规则库对齐,判断是否创建、更新或停用规则,但因CTI与规则格式存在表示差异,关键词和嵌入式搜索效果有限,导致规则对齐认知负担重,引发“规则膨胀”。其次,零日威胁缺乏模拟测试的真实标签,难以验证新规则的正确性,标准指标无法证明规则语义上符合CTI,而使用大语言模型又带来非确定性行为。为此,我们提出FALCON,一个面向CTI驱动的规则检索、生成与验证的智能体框架。核心是一个新颖的CTI-规则语义评分器,量化两者功能对齐程度;该信号同时用于检索相关已部署规则,并驱动无真值验证器评估生成规则。围绕它,生成流水线可实时从CTI生成可部署规则,并通过自我反思的语法、语义和性能验证器不断优化。在自建的CTI-规则数据集上,覆盖网络(Snort)和主机(YARA)平台,FALCON取得0.72的平均相关性,且分析师间一致性达84%,验证了实时安全自动化潜力。
原文摘要 · Abstract (English)
Signature-based Intrusion Detection Systems (IDS) detect malicious activity by matching network or host events against predefined rules. Security analysts manually develop these rules from Cyber Threat Intelligence (CTI). As threats evolve, this manual pipeline faces two bottlenecks. Before authoring a new rule, an analyst must reconcile the incoming CTI with the existing rule base and determine whether to create, update, or retire one. This process is challenging due to the representational differences between the CTI and Rule formats. This gap limits the effectiveness of keyword- and embedding-based search, making rule reconciliation cognitively demanding and, in turn, contributing to "rule bloat". Second, automated verification of a new rule is inherently difficult as zero-day threats lack ground truth from simulated testing. Hence, standard metrics cannot prove that a rule semantically adheres to the CTI, and the use of LLMs leads to non-deterministic behavior. To address these challenges, we introduce FALCON, an agentic framework for CTI-grounded rule retrieval, generation, and validation. At its core, a novel CTI-Rule semantic scorer, quantifies the functional alignment between a CTI and a rule; the same signal drives a retriever that surfaces relevant deployed rules and a ground-truth-free validator that scores generated ones. Around it, a generation pipeline produces deployable rules from CTI in real time and refines them through self-reflective syntactic, semantic, and performance validators. Across network (Snort) and host-based (YARA) platforms on a purpose-built CTI-Rule dataset, FALCON attains a mean relevance of 0.72 (approx), with 84% inter-rater agreement among cybersecurity analysts, underscoring the promise of real-time security automation.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。