用双变压器融合内容与交互信息,提升缺陷分配推荐准确率
TriagerX: Dual Transformers for Bug Triaging Tasks with Content and Interaction Based Rankings
- 双变压器架构从内容和历史交互两方面生成推荐
- 在五个数据集上Top-1准确率提升超10%,开发者推荐最高提升54%
- 适合需精准分配缺陷的工业级开发团队,尤其适用于人员变动场景
预训练语言模型(PLMs)基于Transformer架构,可有效捕捉缺陷报告中的词元语义,优于传统机器学习模型。然而,PLMs可能关注不相关词元,且忽略开发者对相似缺陷的历史互动,影响推荐效果。为此,我们提出TriagerX,采用双变压器架构:两个Transformer分别通过最后三层输出推荐,生成稳健的内容驱动排名;再结合开发者对类似已修复缺陷的历史互动,进行交互式排名优化。在五个数据集上,TriagerX超越所有九种基于Transformer的方法,包括最新基线,通常使Top-1和Top-3推荐准确率提升超过10%。我们与大型产业伙伴合作,成功将其部署于实际开发环境。该伙伴需要同时完成开发者与组件推荐(组件作为团队分配代理,尤其适用于人员变动情况)。我们在其数据集上训练了双任务版本,组件推荐优于基线达10%,开发者推荐提升高达54%。
原文摘要 · Abstract (English)
Pretrained Language Models or PLMs are transformer-based architectures that can be used in bug triaging tasks. PLMs can better capture token semantics than traditional Machine Learning (ML) models that rely on statistical features (e.g., TF-IDF, bag of words). However, PLMs may still attend to less relevant tokens in a bug report, which can impact their effectiveness. In addition, the model can be sub-optimal with its recommendations when the interaction history of developers around similar bugs is not taken into account. We designed TriagerX to address these limitations. First, to assess token semantics more reliably, we leverage a dual-transformer architecture. Unlike current state-of-the-art (SOTA) baselines that employ a single transformer architecture, TriagerX collects recommendations from two transformers with each offering recommendations via its last three layers. This setup generates a robust content-based ranking of candidate developers. TriagerX then refines this ranking by employing a novel interaction-based ranking methodology, which considers developers' historical interactions with similar fixed bugs. Across five datasets, TriagerX surpasses all nine transformer-based methods, including SOTA baselines, often improving Top-1 and Top-3 developer recommendation accuracy by over 10%. We worked with our large industry partner to successfully deploy TriagerX in their development environment. The partner required both developer and component recommendations, with components acting as proxies for team assignments-particularly useful in cases of developer turnover or team changes. We trained TriagerX on the partner's dataset for both tasks, and it outperformed SOTA baselines by up to 10% for component recommendations and 54% for developer recommendations.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。