面向软件运维的专用大模型,提升故障诊断与问答准确率。
OpsLLM: Construction of Large Language Model for Software Operations with Multi-stage Learning

- 分阶段构建:人工校验数据+监督微调+领域流程奖励模型优化
- 故障根因分析准确率提升8.5%~70.3%,问答任务提升0.2%~11.9%
- 开源7B/14B/32B三版本模型及1.5万条标注数据集
在软件运维领域,大语言模型(LLM)受到越来越多关注。然而,由于数据质量低、知识碎片化和学习不足,现有研究尚未实现高效可靠的端到端智能运维。为探索LLM在运维中的潜力,我们提出OpsLLM,一个面向软件运维领域的专用大模型,支持基于知识的问答(QA)和根因分析(RCA)。我们公开了在该领域构建大模型的完整流程:首先通过人机协同机制从海量运维数据中筛选高质量数据,构建微调数据集;随后进行监督微调得到基础模型;进一步在强化学习阶段引入领域流程奖励模型(DPRM),优化模型在RCA任务上的准确性和可靠性。在多种难度的任务上实验表明,OpsLLM有效学习并对齐了运维领域知识,相比现有开源与闭源模型,在问答任务上准确率提升0.2%~11.9%,在根因分析任务上提升8.5%~70.3%,且具备强迁移能力。此外,我们将开源三个参数量分别为7B、14B和32B的OpsLLM版本,以及一个包含15,000条样本的微调数据集。
原文摘要 · Abstract (English)
In the field of software operations, Large Language Models (LLMs) have attracted increasing attention. However, existing research has not yet achieved efficient and effective endto-end intelligent operations due to low-quality data, fragmented knowledge and insufficient learning. To explore the potential of LLMs in software operations, we propose OpsLLM, a domainspecific LLM that supports both knowledge-based question answering (QA) and root cause analysis (RCA). Moreover, we disclose the detailed workflow for building LLMs specifically in the software operations domain. First, a Human-in-the-Loop mechanism is introduced to curate high-quality data from a large collection of operational data and construct a fine-tuning dataset. Then, based on the data, supervised fine-tuning is conducted to achieve a base model. Furthermore, we introduce a domain process reward model (DPRM) during the reinforcement learning stage to optimize the accuracy and reliability of the fine-tuned model on RCA tasks. Experimental results on the tasks with diverse difficulties demonstrate that OpsLLMs effectively learns and aligns with the operational domain knowledge infused, outperforming existing open-source and closed-source LLMs in accuracy with improvements of 0.2%~11.9% on QA tasks and 8.5%~70.3% on RCA tasks, while exhibiting strong transferability. Moreover, we will open-source three versions of OpsLLM with 7B, 14B and 32B parameters, along with a 15K fine-tuning dataset.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。