CALIBURN让入侵检测系统根据运营预算自动调阈值,无需事后调参。
CALIBURN: Operationally Calibrated Streaming Intrusion Detection with Regime-Dependent Conformal Risk Control

- 用操作约束直接决定告警阈值,不再依赖事后调优。
- 在低频攻击场景下AUC-PR达0.943,比最优流式基线快2.21倍。
- 揭示了校准与风险控制对攻击频率的强依赖性,适合生产部署。
流式入侵检测系统需在有限内存下持续处理数据流,但多数方法将告警阈值选择留作事后调优,与生产环境要求不符——运维人员需预先设定告警预算、误判成本和服务水平目标。本文提出CALIBURN,一个基于运营输入而非标签依赖搜索来确定决策阈值的流式告警管道。它由五层构成:截断贝叶斯在线变点检测;后验概率的等单调校准;基于运营成本的代价敏感阈值设定;在可交换性假设下,通过共形风险控制(CRC)将告警预算α映射为严格限制假阳性率的阈值;以及来自站点可靠性工程的多窗口燃烧率告警。各层均经验证,核心贡献在于集成及一项可验证发现:校准与共形风险控制的表现强烈依赖于攻击发生率。在三种场景下——LITNET-2020(5.2%)、CICIDS2017(22%)、UNSW-NB15(64%)——CALIBURN在目标稀有攻击场景中达到AUC-PR 0.943,优于最佳流式基线2.21倍,优于最佳批处理基准4.12倍;等单调校准使布里尔分数降低30%;在中等攻击频率下仍为流式最强;所有方法在基率反转时趋近于基率下限。TTL特征消融实验表明,高频率下的崩溃是流式固有特性,非数据集偏差。我们进一步识别两种机制——理论上的CRC超调量2B/(n0+1)和经验密度退化——导致极小α值时共形告警失效,并建议作为上线前检查项。代码与资源:Apache 2.0,Zenodo DOI 10.5281/zenodo.20074590。
原文摘要 · Abstract (English)
Streaming intrusion detection systems must process flows continuously under bounded memory, yet most leave alerting-threshold selection as a post-hoc tuning problem incompatible with production, where operators commit in advance to alert budgets, misclassification costs, and Service Level Objectives. We present CALIBURN, a streaming alerting pipeline that derives its decision threshold from these operational inputs rather than a label-dependent search. CALIBURN composes five layers on one streaming substrate: truncated Bayesian online change-point detection; isotonic calibration of the posterior to a conditional attack probability; cost-sensitive thresholding from operator costs; a Conformal Risk Control (CRC) wrapper mapping an alert budget alpha to a false-positive-bounded threshold under exchangeability; and multi-window burn-rate alerting from Site Reliability Engineering. Each layer is established; the contribution is the integration and a falsifiable finding about it: the behaviour of calibration and conformal risk control is strongly regime-dependent across attack prevalence. Across three regimes -- LITNET-2020 (5.2%), CICIDS2017 (22%), UNSW-NB15 (64%) -- CALIBURN reaches AUC-PR 0.943 in the rare-attack regime it targets, beating the best streaming baseline by 2.21x and the best batch reference by 4.12x, with isotonic calibration cutting Brier score 30%; it stays strongest among streaming methods at moderate prevalence; and all converge to the prevalence floor under base-rate inversion. A TTL-feature ablation shows this high-prevalence collapse is intrinsic to streaming, not a dataset artifact. We further identify two mechanisms -- a theoretical CRC overshoot 2B/(n0+1) and an empirical-density degeneracy -- collapsing conformal alerting at very small alpha, and propose both as pre-deployment checks. Code and artifacts: Apache 2.0, Zenodo DOI 10.5281/zenodo.20074590.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。