arXiv:2508.19449cs.SEcs.LG2025-08

用Transformer模型理解堆栈上下文,有效减少崩溃报告重复。

Stack Trace-Based Crash Deduplication with Transformer Adaptation

  • 用预训练语言模型适配堆栈痕迹,捕捉整体结构关系
  • 在四个数据集上MRR提升超15%,独特崩溃检测更准
  • 适合需要自动化崩溃归并的软件工程团队

自动化崩溃报告系统会产生大量重复报告,给问题追踪系统带来负担并增加开发工作量。传统基于堆栈痕迹的去重方法——依赖字符串相似度、规则启发式或深度学习模型——往往无法捕捉堆栈痕迹中的上下文与结构关系。我们提出dedupT,一种基于Transformer的方法,将堆栈痕迹整体建模而非孤立帧处理。dedupT首先将预训练语言模型(PLM)适配至堆栈痕迹,再利用其嵌入向量训练全连接网络(FCN),以高效排序重复崩溃。在真实世界数据集上的大量实验表明,dedupT在重复排序和唯一崩溃检测方面均优于现有深度学习与传统方法(如序列对齐与信息检索技术),显著降低人工排查成本。在四个公开数据集上,dedupT的平均倒数排名(MRR)相较最优深度学习基线提升常超过15%,较传统方法提升达10%,同时在检测唯一崩溃报告时获得更高受试者工作特征曲线下面积(ROC-AUC)。本工作推动了现代自然语言处理技术在软件工程中的应用,为基于堆栈痕迹的崩溃去重提供了有效解决方案。

原文摘要 · Abstract (English)

Automated crash reporting systems generate large volumes of duplicate reports, overwhelming issue-tracking systems and increasing developer workload. Traditional stack trace-based deduplication methods---relying on string similarity, rule-based heuristics, or deep learning (DL) models---often fail to capture the contextual and structural relationships within stack traces. We propose dedupT, a transformer-based approach that models stack traces holistically rather than as isolated frames. dedupT first adapts a pretrained language model (PLM) to stack traces, then uses its embeddings to train a fully-connected network (FCN) to rank duplicate crashes effectively. Extensive experiments on real-world datasets show that dedupT outperforms existing DL and traditional methods (e.g., sequence alignment and information retrieval techniques) in both duplicate ranking and unique crash detection, significantly reducing manual triage effort. On four public datasets, dedupT improves Mean Reciprocal Rank (MRR) often by over 15% compared to the best DL baseline and up to 10% over traditional methods while achieving higher Receiver Operating Characteristic Area Under the Curve (ROC-AUC) in detecting unique crash reports. Our work advances the integration of modern natural language processing (NLP) techniques into software engineering, providing an effective solution for stack trace-based crash deduplication.

崩溃分析TransformerNLP软件工程

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。