arXiv:2604.25700cs.SEcs.LG2026-04

仅用错误报告文本实现故障定位,无需代码或运行时信息。

Bug-Report-Driven Fault Localization: Industrial Benchmarking and Lesson Learned at ABB Robotics

论文配图:Bug-Report-Driven Fault Localization: Industrial Benchmarking and Lesson Learned at ABB Robotics
图 1 · 摘自论文原文
  • 将故障定位转为文本分类任务,仅依赖错误报告内容。
  • 传统模型在工业数据上表现优于微调的Transformer模型。
  • 适合缺乏源码访问权限的工业维护场景,可直接部署。

软件质量保障在大型长期运行的工业系统中仍是重大挑战,缺陷定位往往耗时且成本高昂,尤其在维护阶段,开发者主要依赖自然语言错误报告而非完整的运行时或代码上下文。本研究探索仅基于错误报告文本内容,利用人工智能支持故障定位的可行性。该方法不需源码、执行轨迹或静态分析结果,可直接融入现有工业维护流程。我们将故障定位建模为监督文本分类问题,评估了三种传统机器学习模型(逻辑回归、支持向量机、随机森林)和两种微调的Transformer模型(RoBERTa-Base、Distil-RoBERTa)。实验使用瑞典ABB机器人公司五年的已解决错误报告数据,每条报告均关联已验证的代码修复。结果显示,使用词频-逆文档频率特征的传统模型始终优于微调的Transformer模型;数据增强可提升随机森林性能。这一发现挑战了在领域特定数据上Transformer模型普遍优于经典方法的假设。研究证明历史错误报告可系统用于基于文本的人工智能辅助故障定位,为工业调试实践提供一种可扩展、低成本且实证有效的补充手段。

原文摘要 · Abstract (English)

Software quality assurance remains a major challenge in industrial environments, where large-scale and long-lived systems inevitably accumulate defects. Identifying the location of a fault is often time-consuming and costly, particularly during maintenance phases when developers must rely primarily on textual bug reports rather than complete runtime or code-level context. In this study, we investigated if artificial intelligence can support fault localization using only the natural-language content of bug reports. By relying only on textual information, our approach requires no access to source code, execution traces, or static analysis artifacts, making it directly deployable within existing industrial maintenance workflows. We framed fault localization as a supervised text classification problem and evaluated three traditional machine learning models (Logistic Regression, Support Vector Machine, and Random Forest) and two fine-tuned transformer-based language models (RoBERTa-Base and Distil-RoBERTa). Our evaluation used proprietary data from ABB Robotics in Sweden, comprising five years of resolved industrial bug reports, each linked to its verified code fix. This setting allowed us to assess model effectiveness under realistic industrial constraints. Our results showed that traditional models using term frequency-inverse document features consistently outperformed the fine-tuned language models on this dataset, while data augmentation improved Random Forest performance. These findings challenge the assumption that transformer-based models universally outperform classical approaches in industrial contexts with domain-specific data. We demonstrated that historical bug reports can be systematically used for text-based, artificial intelligence-assisted fault localization, providing a scalable, low-cost, and empirically grounded complement to common debugging practices in industry.

故障定位工业应用文本分类AI调试

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。