用指令学习统一日志分析,让一个模型搞定多种任务。
LogLM: From Task-based to Instruction-based Automated Log Analysis
- 将多任务日志数据转为指令-响应格式训练模型
- 在五项日志分析任务上均超越现有方法
- 适合需要灵活应对复杂日志场景的运维人员
自动化日志分析对软件系统的高效运维至关重要,可提供系统行为的关键洞察。然而,现有方法大多将日志分析视为使用特定任务标签对训练单一任务模型(如异常检测、日志解析等)的问题。这类任务导向的方法在泛化到复杂场景时灵活性差,依赖特定任务的训练数据,且部署多个模型成本高昂。本文提出一种基于指令的训练方法,将来自多个任务和领域的日志-标签对转换为统一的指令-响应对格式。我们训练的模型LogLM能够理解复杂用户指令,并在不同任务间表现出更强的泛化能力,从而提升灵活性并减少对特定任务训练数据的依赖。通过将主要日志分析任务整合到单个模型中,该方法也减轻了模型部署负担。实验表明,LogLM在五项日志分析能力上均优于现有方法,并展现出对复杂指令和未见任务的强大泛化能力。
原文摘要 · Abstract (English)
Automatic log analysis is essential for the efficient Operation and Maintenance (O&M) of software systems, providing critical insights into system behaviors. However, existing approaches mostly treat log analysis as training a model to perform an isolated task ( e.g., anomaly detection, log parsing, etc.) using task-specific log-label pairs. These task-based approaches are inflexible in generalizing to complex scenarios, depend on task-specific training data, and cost significantly when deploying multiple models. In this paper, we propose an instruction-based training approach that transforms log-label pairs from multiple tasks and domains into a unified format of instruction-response pairs. Our trained model, LogLM, can follow complex user instructions and generalize better across different tasks, thereby increasing flexibility and reducing the dependence on task-specific training data. By integrating major log analysis tasks into a single model, our approach also relieves model deployment burden. Experimentally, LogLM outperforms existing approaches across five log analysis capabilities, and exhibits strong generalization abilities on complex instructions and unseen tasks.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。