系统梳理AI需求工程现状,揭示三大核心挑战。
How Mature is Requirements Engineering for AI-based Systems? A Systematic Mapping Study on Practices, Challenges, and Future Research Directions
- 通过检索与滚雪球法收集126篇论文,系统分析现有方法
- 发现需求规格、可解释性及工程师与用户间鸿沟是主要难题
- 为研究者提供7个未来方向,助实践者选对方法
人工智能已渗透至生活各领域,带来人工智能需求工程(RE4AI)新挑战,如难以定义和验证AI需求,或因新兴伦理问题需考虑新的质量属性。当前尚不明确现有需求工程方法是否足够,或是否需要新方法应对。为此,我们旨在为研究人员和实践者提供一份关于RE4AI的全面概览:迄今已实现哪些实践?仍存在哪些研究空白与挑战?通过结合查询字符串搜索与广泛滚雪球法,我们筛选出126篇原始研究。现有研究主要集中于需求分析与获取,多数方法应用于这些环节。此外,我们识别出需求规格化、可解释性以及机器学习工程师与最终用户间的差距是最普遍的挑战,另有若干其他挑战。同时,我们提出了七个潜在的研究方向以应对这些挑战。实践者可据此识别并选择适用于其AI系统的合适方法,研究者则可基于已识别的空白与方向推动该领域发展。
原文摘要 · Abstract (English)
Artificial intelligence (AI) permeates all fields of life, which resulted in new challenges in requirements engineering for artificial intelligence (RE4AI), e.g., the difficulty in specifying and validating requirements for AI or considering new quality requirements due to emerging ethical implications. It is currently unclear if existing RE methods are sufficient or if new ones are needed to address these challenges. Therefore, our goal is to provide a comprehensive overview of RE4AI to researchers and practitioners. What has been achieved so far, i.e., what practices are available, and what research gaps and challenges still need to be addressed? To achieve this, we conducted a systematic mapping study combining query string search and extensive snowballing. The extracted data was aggregated, and results were synthesized using thematic analysis. Our selection process led to the inclusion of 126 primary studies. Existing RE4AI research focuses mainly on requirements analysis and elicitation, with most practices applied in these areas. Furthermore, we identified requirements specification, explainability, and the gap between machine learning engineers and end-users as the most prevalent challenges, along with a few others. Additionally, we proposed seven potential research directions to address these challenges. Practitioners can use our results to identify and select suitable RE methods for working on their AI-based systems, while researchers can build on the identified gaps and research directions to push the field forward.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。