用强化学习动态调整云安全检测阈值,减少大模型调用58.78%
A Multi-Layer Cloud-IDS Pipeline with LLM and Adaptive Q-Learning Calibration

- 三层检测架构+自适应阈值,低置信度事件分流至记忆匹配与大模型
- 相比静态阈值降低58.78%大模型调用,保持88.68%准确率
- 适合需要低成本高可靠性的云安全运维团队
云安全因分层架构、动态环境及未知攻击而面临挑战。本文构建了一个多层云入侵检测系统,覆盖网络、主机和虚拟化层。各层使用机器学习识别已知攻击模式,通过预测置信度区分可信与可疑结果。低置信度事件依次经由学习型阈值门(Gate-1)、Chroma内存匹配门(Gate-2),未解决者升至大语言模型(LLM)进行语义分析与解释。最终在Gate-3以校准的LLM置信度或加权融合决定是否标记为攻击,不确定事件存入待审桶避免强制分类。生成的解释与确认知识存入ChromaDB用于后续分析与重训练。实验基于静态阈值建立基线,结果表明系统可自适应调整阈值,使LLM调用减少58.78%,同时维持88.68%准确率、85.29%精确率、84.72%召回率、85.00%F1,网络与虚拟化层分别达到98.02%与97.08%准确率。
原文摘要 · Abstract (English)
Security in cloud computing has become a major concern due to several factors such as layered cloud architectures, dynamic environments, and exposure to unseen or zero-day attacks. Moreover, intrusion detection systems (IDS) typically operate at specific layers and rely heavily on machine learning models, which often perform well in experimental settings but fail to sustain performance in real cloud deployments. In this work, we implement a confidence-aware multilevel intrusion detection system using reinforcement learning tailored for cloud environments. The system secures three distinct layers: network, host, and hypervisor. Machine learning models at each layer detect known attack patterns, while prediction confidence distinguishes reliable decisions from uncertain outcomes. Within the multi-gate flow, low-confidence events pass through a learned-threshold confidence gate (Gate-1), followed by a Chroma memory-matching gate (Gate-2), with unresolved events escalated to a large language model (LLM) for semantic analysis and explanation. Final attack promotion at Gate-3 uses calibrated LLM confidence or weighted-fusion fallback, while uncertain events are retained in a review bucket to avoid forced classification. Generated explanations and confirmed knowledge are stored in ChromaDB to support future analysis and retraining. The approach is first evaluated using static thresholds, establishing a baseline for comparison. Results show that the proposed system learns adaptive thresholds and reduces LLM escalation by 58.78%, lowering cost while maintaining strong performance (88.68% accuracy, 85.29% precision, 84.72% recall, 85.00% F1). The network and hypervisor layers achieve 98.02% and 97.08% accuracy, demonstrating a balanced and efficient detection system.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。