arXiv:2505.01783cs.LGcs.IT2025-05被引 4

用合成数据提升异常检测,实时保证误报率可控。

Online Conformal Anomaly Detection with Prediction-Powered Data Acquisition

  • 结合上下文信息,用合成数据替代真实校准数据
  • 在线检测中保持误报率严格受控,不依赖真实数据流
  • 适合对可靠性要求高的工业、医疗和网络监控场景

在线异常检测在网络安全、医疗健康、工业监控和电信领域至关重要,及时发现行为偏差可避免重大故障或安全事件。尽管已有大量基于监督或无监督学习的异常评分方法,但目前唯一能提供无假设误报率(FDR)保障的方法依赖持续的真实校准数据流。为此,我们提出上下文感知的预测驱动自适应共形在线异常检测(C-PP-COAD),通过战略性使用合成校准数据缓解数据稀缺问题,并根据上下文信息自适应融合真实数据。该框架可嵌入任意现有异常检测方法,利用给定异常评分构建主动共形p值统计量,支持在线检验并实现严格的FDR控制,确保长期可靠的异常检测性能。在合成数据及多个真实数据集上的实验表明,包括甲状腺功能异常检测、O-RAN冲突检测、5G网络入侵检测和O-RAN用户设备吞吐量下降检测,C-PP-COAD显著降低了对真实校准数据的依赖,同时维持了保障性的FDR控制。

原文摘要 · Abstract (English)

Online anomaly detection is essential in fields such as cybersecurity, healthcare, industrial monitoring, and telecommunications, where promptly identifying deviations from expected behavior can avert critical failures or security breaches. While numerous anomaly scoring methods based on supervised or unsupervised learning have been proposed, the only existing approach capable of providing assumption-free guarantees on the false discovery rate (FDR) rely on a continuous stream of real-world calibration data. To address this limitation, we introduce context-aware prediction-powered conformal online anomaly detection (C-PP-COAD), a novel principled framework that strategically leverages synthetic calibration data to mitigate data scarcity, while adaptively integrating real data based on contextual information. C-PP-COAD wraps around any existing anomaly detection method, leveraging any given anomaly score to construct active conformal p-value statistics. These statistics support online testing with formal FDR control, maintaining rigorous and reliable anomaly detection performance over time. Experiments conducted on both synthetic and real-world datasets, including thyroid dysfunction detection, O-RAN conflict detection, 5G network intrusion detection, and O-RAN UE throughput degradation detection, demonstrate that C-PP-COAD significantly reduces dependency on real calibration data without compromising guaranteed FDR control.

异常检测在线学习共形推断

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。