arXiv:2601.20148cs.SEcs.LG2026-01中稿 · presentation at Mi…被引 3

用智能筛选减少CI日志量,让大模型分析更高效环保。

LogSieve: Task-Aware CI Log Reduction for Sustainable LLM-Based Analysis

  • 基于语义和根因分析,自动过滤低信息日志行。
  • 日志行减少42%,词元减少40%,语义保留率超90%。
  • 适合关注CI效率与绿色计算的开发者和运维团队。

日志对理解持续集成(CI)行为至关重要,尤其在诊断构建失败和性能退化时。然而其日益增长的规模和冗余性使得人工检查和自动化分析愈发耗时、昂贵且环境成本高。现有工作多针对结构化系统日志,而忽视了CI流程中常见的非结构化、嘈杂、冗长的日志。我们提出LogSieve,一种轻量级、根因感知且语义保真的日志压缩方法,在保留下游推理相关性的同时过滤低信息内容。在20个开源Android项目(使用GitHub Actions)的CI日志上评估,LogSieve平均实现42%的行数减少和40%的词元减少,语义损失极小。该预处理显著降低计算成本,并可按比例减少大模型推理中的能耗与碳排放。相比结构优先基线(LogZip与随机删除),LogSieve在语义与类别保真度上表现更优(余弦相似度0.93,GPTScore 0.93,精确匹配准确率80%)。基于嵌入的分类器实现近人类精度(97%),支持可扩展的语义感知过滤,可无缝集成至CI工作流。LogSieve连接日志管理与大模型推理,为更绿色、可解释的CI自动化提供可行路径。

原文摘要 · Abstract (English)

Logs are essential for understanding Continuous Integration (CI) behavior, particularly for diagnosing build failures and performance regressions. Yet their growing volume and verbosity make both manual inspection and automated analysis increasingly costly, time-consuming, and environmentally costly. While prior work has explored log compression, anomaly detection, and LLM-based log analysis, most efforts target structured system logs rather than the unstructured, noisy, and verbose logs typical of CI workflows. We present LogSieve, a lightweight, RCA-aware and semantics-preserving log reduction technique that filters low-information lines while retaining content relevant to downstream reasoning. Evaluated on CI logs from 20 open-source Android projects using GitHub Actions, LogSieve achieves an average 42% reduction in lines and 40% reduction in tokens with minimal semantic loss. This pre-inference reduction lowers computational cost and can proportionally reduce energy use (and associated emissions) by decreasing the volume of data processed during LLM inference. Compared with structure-first baselines (LogZip and random-line removal), LogSieve preserves much higher semantic and categorical fidelity (Cosine = 0.93, GPTScore = 0.93, 80% exact-match accuracy). Embedding-based classifiers automate relevance detection with near-human accuracy (97%), enabling scalable and sustainable integration of semantics-aware filtering into CI workflows. LogSieve thus bridges log management and LLM reasoning, offering a practical path toward greener and more interpretable CI automation.

CI日志LLM推理绿色计算日志压缩

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。