arXiv:2510.08622cs.CLcs.SE2025-10

用AI自动对齐访谈记录与需求,提升需求提取效率。

Automated Alignment between Elicitation Interviews and Requirements

  • 提出两个对齐指标:需求忠实度与访谈覆盖率。
  • LLM方法在四数据集上达0.86宏F1,可自动评估对齐效果。
  • 嵌入模型可作预筛提升效率,适合需求工程研究者使用。

软件需求常源于访谈等对话式采集方式,但验证需求是否准确反映利益相关者意图仍依赖人工。本文将访谈转录文本与用户故事形式的需求进行对齐建模,提出两个启发式度量:(i) 需求忠实度(被转录内容支持的故事占比),(ii) 访谈覆盖率(被至少一个故事覆盖的转录内容占比)。通过在四个数据集上测试大语言模型和嵌入模型,发现基于LLM的方法在人工标注的片段-故事对上达到0.86宏F1。同时表明嵌入模型可作为筛选器提升可扩展性。该工作为对话型文档与需求间的关联分析奠定基础,其框架与匹配技术可用于需求追溯、对话生成需求等新兴任务。

原文摘要 · Abstract (English)

Software requirements are derived from a variety of elicitation techniques, many of which have a conversational nature, like interviews. However, evaluating whether those derived requirements faithfully reflect the stakeholders' needs remains a challenging manual task. In this paper, we formalize the task of aligning the transcript of an interview with a collection of requirements represented as user stories. We propose two heuristic metrics for alignment, called (i) requirements faithfulness: the proportion of stories supported by the transcript, and (ii) interview coverage: the proportion of transcript supported by at least one story. Then, we run experiments with large language models and embedding models that assess the ability of evaluating these metrics automatically. Experiments over four datasets show that an LLM-based solution achieves 0.86 macro-F1 on manually labeled chunk-story pairs. We also show how embedding models can be used as blockers to make the approach more scalable. This work paves the way for more research on linking conversational artifacts with requirements. The formal framework and the automated matching techniques are basic components that can be used for emerging tasks such as tracing requirements to interviews and generating requirements from conversations.

需求工程对话分析LLM应用

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。