用大模型+聚类分析日志,让安全人员秒懂海量日志
LLMLogAnalyzer: A Clustering-Based Log Analysis Chatbot using Large Language Models
- 先聚类再分步处理,突破大模型处理日志的结构瓶颈
- 相比ChatGPT等工具,任务准确率提升39%至68%
- 适合安全团队和不懂技术的用户快速排查日志异常
系统日志是网络安全的核心,支持事前漏洞预防和事后事件调查。然而,面对海量多样的日志数据,许多组织因成本高、缺乏专业人才和时间限制,难以开展基本分析。本文提出LLMLogAnalyzer,一种基于聚类的日志分析聊天机器人,融合大语言模型(LLMs)与机器学习算法,简化并加速日志分析流程。该方法克服了大模型在上下文长度和结构化文本处理上的局限性,有效提升摘要生成、模式提取和异常检测能力。在四个不同领域的日志数据集上评估显示,其性能显著优于现有顶尖大模型聊天机器人(如ChatGPT、ChatPDF、NotebookLM),各项任务准确率提升39%至68%。系统还表现出强鲁棒性,使用ROUGE-1评分时,结果离散度降低93%(IQR减少)。其模块化架构包含路由、日志识别、解析器和搜索工具,增强大模型对结构化文本的理解能力,提升分析精度与稳定性,为网络安全专家及非技术人员提供高效工具。
原文摘要 · Abstract (English)
System logs are a cornerstone of cybersecurity, supporting proactive breach prevention and post-incident investigations. However, analyzing vast amounts of diverse log data remains significantly challenging, as high costs, lack of in-house expertise, and time constraints make even basic analysis difficult for many organizations. This study introduces LLMLogAnalyzer, a clustering-based log analysis chatbot that leverages Large Language Models (LLMs) and Machine Learning (ML) algorithms to simplify and streamline log analysis processes. This innovative approach addresses key LLM limitations, including context window constraints and poor structured text handling capabilities, enabling more effective summarization, pattern extraction, and anomaly detection tasks. LLMLogAnalyzer is evaluated across four distinct domain logs and various tasks. Results demonstrate significant performance improvements over state-of-the-art LLM-based chatbots, including ChatGPT, ChatPDF, and NotebookLM, with consistent gains ranging from 39% to 68% across different tasks. The system also exhibits strong robustness, achieving a 93% reduction in interquartile range (IQR) when using ROUGE-1 scores, indicating significantly lower result variability. The framework's effectiveness stems from its modular architecture comprising a router, log recognizer, log parser, and search tools. This design enhances LLM capabilities for structured text analysis while improving accuracy and robustness, making it a valuable resource for both cybersecurity experts and non-technical users.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。