arXiv:2504.14797cs.SEcs.AI2025-04被引 4

用机器学习自动识别开源项目中的重复缺陷报告,提升问题管理效率。

Automated Duplicate Bug Report Detection in Large Open Bug Repositories

  • 基于文本内容的六种机器学习方法检测重复报告
  • 准确率在70%至90%之间,优于传统top-k方法
  • 适合软件工程、缺陷管理领域的研究人员和开发者

大型开源项目的用户和贡献者常向问题追踪系统提交软件缺陷或改进建议(即缺陷报告),但有时会重复报告已存在的问题。原因包括缺乏足够时间检索已有报告,或不具备相关领域专业知识而未察觉内容重复。本文提出一种基于机器学习的新方法,利用报告文本数据自动检测开源仓库中的重复缺陷报告。我们对比了六种方法:主题建模、高斯朴素贝叶斯、深度学习、基于时间的组织、聚类,以及使用生成式预训练大语言模型的摘要法。此外,我们引入一种新的阈值判定方法,区别于文献中常用的top-k选择策略。实验在Eclipse开源项目公开数据集上进行,结果表明所有方法均表现良好,准确率范围为70%至90%。

原文摘要 · Abstract (English)

Many users and contributors of large open-source projects report software defects or enhancement requests (known as bug reports) to the issue-tracking systems. However, they sometimes report issues that have already been reported. First, they may not have time to do sufficient research on existing bug reports. Second, they may not possess the right expertise in that specific area to realize that an existing bug report is essentially elaborating on the same matter, perhaps with a different wording. In this paper, we propose a novel approach based on machine learning methods that can automatically detect duplicate bug reports in an open bug repository based on the textual data in the reports. We present six alternative methods: Topic modeling, Gaussian Naive Bayes, deep learning, time-based organization, clustering, and summarization using a generative pre-trained transformer large language model. Additionally, we introduce a novel threshold-based approach for duplicate identification, in contrast to the conventional top-k selection method that has been widely used in the literature. Our approach demonstrates promising results across all the proposed methods, achieving accuracy rates ranging from the high 70%'s to the low 90%'s. We evaluated our methods on a public dataset of issues belonging to an Eclipse open-source project.

缺陷检测文本分类机器学习开源软件

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。