arXiv:2504.00513cs.SEcs.AI2025-04被引 11

用大模型从论文摘要生成AI系统用户故事,构建首个公开数据集。

Leveraging LLMs for User Stories in AI Systems: UStAI Dataset

  • 基于论文摘要,用三款大模型生成1260条用户故事。
  • 生成故事符合质量标准,能反映多利益相关方需求。
  • 适合研究早期需求获取或伦理分析的学者使用。

AI系统在各领域广泛应用,但其需求获取面临挑战,尤其因技术保密性导致开源需求文档匮乏。本文探索利用大语言模型(LLMs)根据学术论文摘要生成AI系统用户故事。通过三款LLMs对26个领域的42篇论文摘要进行实验,共生成1260条用户故事,并采用质量用户故事(QUS)框架评估其质量,同时识别非功能性需求与伦理原则。结果表明,这些模型能有效生成符合多利益相关方需求的用户故事,为研究和早期需求采集提供可行方案。研究整理并发布了首个公开的用户故事数据集——UStAI,供学术界使用。

原文摘要 · Abstract (English)

AI systems are gaining widespread adoption across various sectors and domains. Creating high-quality AI system requirements is crucial for aligning the AI system with business goals and consumer values and for social responsibility. However, with the uncertain nature of AI systems and the heavy reliance on sensitive data, more research is needed to address the elicitation and analysis of AI systems requirements. With the proprietary nature of many AI systems, there is a lack of open-source requirements artifacts and technical requirements documents for AI systems, limiting broader research and investigation. With Large Language Models (LLMs) emerging as a promising alternative to human-generated text, this paper investigates the potential use of LLMs to generate user stories for AI systems based on abstracts from scholarly papers. We conducted an empirical evaluation using three LLMs and generated $1260$ user stories from $42$ abstracts from $26$ domains. We assess their quality using the Quality User Story (QUS) framework. Moreover, we identify relevant non-functional requirements (NFRs) and ethical principles. Our analysis demonstrates that the investigated LLMs can generate user stories inspired by the needs of various stakeholders, offering a promising approach for generating user stories for research purposes and for aiding in the early requirements elicitation phase of AI systems. We have compiled and curated a collection of stories generated by various LLMs into a dataset (UStAI), which is now publicly available for use.

用户故事大模型需求工程数据集

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。