用情感分析和BERT主题建模预测开源软件漏洞修复时间与结果
Bug Destiny Prediction in Large Open-Source Software Repositories through Sentiment Analysis and BERT Topic Modeling
- 结合情感分析与BERTopic提取漏洞情绪和主题特征
- 情感分析能有效预测漏洞是否被修复,准确率提升显著
- 适合软件工程与缺陷管理研究者阅读
本研究探索一种新方法,通过分析Bugzilla Eclipse项目数据,预测漏洞的修复时间、解决时间及最终状态。利用漏洞解决前可用的特征,融合情感分析获取情绪分值与正负情感分类,同时引入优先级和基于BERTopic模型提取的主题信息,输入卷积神经网络(CNN)与多层感知机(MLP)。结果表明,结合BERTopic与情感分析可提升部分模型性能;平衡输入虽增强实用性,但多数情况下导致准确率显著下降。针对修复时间、修复时长及漏洞最终命运的预测,采用二分类与精确时间值预测对比评估效果。结果显示,情感分析对判断漏洞是否被修复具有重要预测价值,但在复杂或非常规结果分类中作用减弱。
原文摘要 · Abstract (English)
This study explores a novel approach to predicting key bug-related outcomes, including the time to resolution, time to fix, and ultimate status of a bug, using data from the Bugzilla Eclipse Project. Specifically, we leverage features available before a bug is resolved to enhance predictive accuracy. Our methodology incorporates sentiment analysis to derive both an emotionality score and a sentiment classification (positive or negative). Additionally, we integrate the bug's priority level and its topic, extracted using a BERTopic model, as features for a Convolutional Neural Network (CNN) and a Multilayer Perceptron (MLP). Our findings indicate that the combination of BERTopic and sentiment analysis can improve certain model performance metrics. Furthermore, we observe that balancing model inputs enhances practical applicability, albeit at the cost of a significant reduction in accuracy in most cases. To address our primary objectives, predicting time-to-resolution, time-to-fix, and bug destiny, we employ both binary classification and exact time value predictions, allowing for a comparative evaluation of their predictive effectiveness. Results demonstrate that sentiment analysis serves as a valuable predictor of a bug's eventual outcome, particularly in determining whether it will be fixed. However, its utility is less pronounced when classifying bugs into more complex or unconventional outcome categories.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。