arXiv:2412.14802cs.SEcs.AI2024-12被引 3

提出高效准确的堆栈跟踪去重方法,支持真实场景大规模应用。

Stack Trace Deduplication: Faster, More Accurately, and in More Realistic Scenarios

  • 采用编码+近邻搜索+重排序的双阶段模型,快速匹配相似堆栈。
  • 在开源数据集和新工业数据集上均实现更高准确率与更快速度。
  • 适用于需要实时处理海量错误报告的工程实践场景。

大型软件系统中,错误发生时往往缺乏完整的用户描述,开发者依赖堆栈跟踪(即引发错误的函数调用序列)进行排查。由于同一问题可能产生成千上万条不同用户的堆栈跟踪,自动去重分类成为必要。现有深度学习方法虽表现优异,但多在孤立环境下评估,难以反映实际应用效果。本文提出三项贡献:一个新模型、一个基于工业场景的数据集(SlowOps)、以及多维度真实评估。模型包含两部分:(1) 基于字节对编码与近似最近邻搜索的嵌入模型,快速定位最相关堆栈;(2) 重排序模块,综合考虑堆栈间的重复帧进行优化。我们发布SlowOps数据集,包含来自JetBrains IntelliJ产品的堆栈跟踪,每类数量比现有开源数据集高出一个数量级。评估涵盖分类准确率、处理耗时及新类别生成能力,结果表明本模型在多个数据集上均优于现有方法,且运行更快。代码与数据已公开,旨在推动该领域面向实际应用的研究。

原文摘要 · Abstract (English)

In large-scale software systems, there are often no fully-fledged bug reports with human-written descriptions when an error occurs. In this case, developers rely on stack traces, i.e., series of function calls that led to the error. Since there can be tens and hundreds of thousands of them describing the same issue from different users, automatic deduplication into categories is necessary to allow for processing. Recent works have proposed powerful deep learning-based approaches for this, but they are evaluated and compared in isolation from real-life workflows, and it is not clear whether they will actually work well at scale. To overcome this gap, this work presents three main contributions: a novel model, an industry-based dataset, and a multi-faceted evaluation. Our model consists of two parts - (1) an embedding model with byte-pair encoding and approximate nearest neighbor search to quickly find the most relevant stack traces to the incoming one, and (2) a reranker that re-ranks the most fitting stack traces, taking into account the repeated frames between them. To complement the existing datasets collected from open-source projects, we share with the community SlowOps - a dataset of stack traces from IntelliJ-based products developed by JetBrains, which has an order of magnitude more stack traces per category. Finally, we carry out an evaluation that strives to be realistic: measuring not only the accuracy of categorization, but also the operation time and the ability to create new categories. The evaluation shows that our model strikes a good balance - it outperforms other models on both open-source datasets and SlowOps, while also being faster on time than most. We release all of our code and data, and hope that our work can pave the way to further practice-oriented research in the area.

堆栈去重工业数据实时处理模型评估

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。