对比AI在软件测试中的期待与实际应用,发现落地效果远未达预期。
Expectations vs Reality -- A Secondary Study on AI Adoption in Software Testing
- 通过系统映射研究分析2020年后工业界AI测试实证研究
- 仅少数实际应用案例,测试用例生成等潜力未充分释放
- 适合关注AI落地瓶颈的测试工程师和研究者参考
在软件行业,人工智能(AI)在开发活动中应用日益广泛,但在测试环节尚未实现显著突破。本文旨在识别近年来(2020年及以后)关于工业界AI在软件测试中采纳情况的实证研究,并分析其实际应用现状。通过系统映射研究和主题分析,我们发现:尽管存在大量潜在应用场景(如测试用例生成、代码分析、智能自动化测试),但实际部署案例和可观察收益仍十分有限。此外,研究还揭示了使用‘artificial intelligence’作为关键词时,在线数据库存在虚假阳性结果的问题,影响研究检索有效性。整体表明,当前工业界对AI在测试中的应用仍处于探索阶段,实际成效与预期之间存在明显差距。
原文摘要 · Abstract (English)
In the software industry, artificial intelligence (AI) has been utilized more and more in software development activities. In some activities, such as coding, AI has already been an everyday tool, but in software testing activities AI it has not yet made a significant breakthrough. In this paper, the objective was to identify what kind of empirical research with industry context has been conducted on AI in software testing, as well as how AI has been adopted in software testing practice. To achieve this, we performed a systematic mapping study of recent (2020 and later) studies on AI adoption in software testing in the industry, and applied thematic analysis to identify common themes and categories, such as the real-world use cases and benefits, in the found papers. The observations suggest that AI is not yet heavily utilized in software testing, and still relatively few studies on AI adoption in software testing have been conducted in the industry context to solve real-world problems. Earlier studies indicated there was a noticeable gap between the actual use cases and actual benefits versus the expectations, which we analyzed further. While there were numerous potential use cases for AI in software testing, such as test case generation, code analysis, and intelligent test automation, the reported actual implementations and observed benefits were limited. In addition, the systematic mapping study revealed a potential problem with false positive search results in online databases when using the search string "artificial intelligence".
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。