arXiv:2511.05878cs.LGcs.SE2025-11被引 1

无需标签日志,融合通用与专属知识实现跨系统异常检测

FusionLog: Cross-System Log-based Anomaly Detection via Fusion of General and Proprietary Knowledge

  • 通过语义相似度动态划分目标日志为通用与专属两类
  • 零标签下F1超90%,显著优于现有跨系统方法
  • 适合新系统快速部署,无需人工标注日志

基于日志的异常检测对保障网络系统稳定至关重要。现有方法依赖成熟系统的大量标注日志和新系统的少量标注日志,通过迁移学习提取通用知识,但忽略通用知识与目标系统专属知识的差异,限制性能。为此,我们提出FusionLog,一种无需目标系统标签的跨系统日志异常检测新方法,可有效融合通用与专属知识,实现无标签下的跨系统泛化。首先设计基于语义相似度的免训练路由机制,将未标注目标日志动态划分为‘通用日志’和‘专属日志’。对于通用日志,采用基于系统无关表示元学习的小模型直接训练与推理,继承源系统与目标系统共享的异常模式。对于专属日志,通过大语言模型(LLM)与小模型(SM)多轮协同知识蒸馏与融合,迭代生成伪标签并微调小模型,增强其识别目标系统特有异常模式的能力。在三个不同系统公开日志数据集上的实验表明,FusionLog在完全零标签设置下达到超过90%的F1分数,显著优于当前最先进的跨系统日志异常检测方法。

原文摘要 · Abstract (English)

Log-based anomaly detection is critical for ensuring the stability and reliability of web systems. One of the key problems in this task is the lack of sufficient labeled logs, which limits the rapid deployment in new systems. Existing works usually leverage large-scale labeled logs from a mature web system and a small amount of labeled logs from a new system, using transfer learning to extract and generalize general knowledge across both domains. However, these methods focus solely on the transfer of general knowledge and neglect the disparity and potential mismatch between such knowledge and the proprietary knowledge of target system, thus constraining performance. To address this limitation, we propose FusionLog, a novel zero-label cross-system log-based anomaly detection method that effectively achieves the fusion of general and proprietary knowledge, enabling cross-system generalization without any labeled target logs. Specifically, we first design a training-free router based on semantic similarity that dynamically partitions unlabeled target logs into 'general logs' and 'proprietary logs.' For general logs, FusionLog employs a small model based on system-agnostic representation meta-learning for direct training and inference, inheriting the general anomaly patterns shared between the source and target systems. For proprietary logs, we iteratively generate pseudo-labels and fine-tune the small model using multi-round collaborative knowledge distillation and fusion based on large language model (LLM) and small model (SM) to enhance its capability to recognize anomaly patterns specific to the target system. Experimental results on three public log datasets from different systems show that FusionLog achieves over 90% F1-score under a fully zero-label setting, significantly outperforming state-of-the-art cross-system log-based anomaly detection methods.

异常检测日志分析零样本知识融合

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。