小模型微调后可高效识别日志问题并给出解决方案。
Fine-Tuning Small Language Models for Solution-Oriented Windows Event Log Analysis
- 用大模型生成合成日志数据,训练小模型专注问题定位与修复。
- 微调后的小模型在识别率和修复建议上优于大模型,资源消耗更低。
- 适合本地部署的运维场景,尤其关注安全与低延迟的系统管理。
大型语言模型(LLMs)在日志分析中表现优异,但其高计算开销、依赖云端及安全顾虑限制了实际应用。现有方法多仅定位问题,缺乏可操作的修复建议。小型语言模型(SLMs)作为轻量替代方案,可通过微调实现特定任务,且支持本地部署。本文首先利用高性能大模型构建大规模合成Windows事件日志数据集,包含真实修复动作;随后采用LoRA参数高效微调技术对多个SLMs和LLMs进行训练,并通过专家评估对比性能。结果表明,该数据集能准确反映真实场景,微调后的SLMs在问题识别与修复建议相关性上持续优于LLMs,同时显著降低计算资源需求。
原文摘要 · Abstract (English)
Large language models (LLMs) have shown promise for event log analysis, but their high computational requirements, reliance on cloud infrastructure, and security concerns limit practical deployment. In addition, most existing approaches focus only on the identification of the problem and do not provide actionable remediation. Small language models (SLMs) present a light-weight alternative that can be fine-tuned for a specific purpose and hosted locally. This paper investigates whether SLMs, when fine-tuned for a specific task, can serve as a practical alternative for event log analysis while also generating solutions. We first create a large-scale synthetic Windows event log dataset that contains remediation actions using a high-performing LLM. We then fine-tune multiple SLMs and LLMs using the LoRA parameter-efficient fine-tuning technique and evaluate their performance by comparing with expert assessment. The results show that the dataset accurately reflects real-world scenarios and that fine-tuned SLMs consistently outperform LLMs in identifying issues and providing relevant remediation, while requiring fewer computational resources.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。