用AI从原型图自动生成开发待办事项,提升早期需求梳理效率
How Well Can AI Generate Backlogs from App Mockups?

- 结合视觉与语言推理的多模态提示策略生成待办项
- 用户故事和史诗级任务平均F1达52-66%,后端任务精度提升35%
- 开发者认可26%误报仍具参考价值,适合敏捷开发团队试用
生成冲刺待办事项需大量人工投入,常遗漏或不一致。我们提出一种多模态方法,从早期项目阶段的可视化原型图中支持待办事项生成。在GPT-4o上评估三种提示策略:零样本基线、组合式思维链(CCoT)用于视觉-语言推理,以及角色驱动提示。研究涵盖两个国家的七个项目,并访谈开发人员。结果显示,基线提示更重召回率,而CCoT更均衡,用户故事与史诗级任务平均F1为52%-66%;任务生成较难。加入架构上下文后,精度提升最显著,后端任务最高达35%。开发者访谈显示,最多26%的误报仍具实用价值,反映待办创建的创造性与开放性。为此我们提出新指标‘修正召回率’,结合真实标注与开发者评估。结果表明,融合架构上下文的混合提示可辅助从早期原型图生成待办项,但结果因条目类型而异,仍需开发者监督。
原文摘要 · Abstract (English)
Creating sprint backlogs requires considerable effort, as items such as epics, user stories, and tasks can be missed or inconsistently specified. We propose a multimodal approach to support backlog generation from visual app mockups, an artifact available at early project stages. We evaluate three prompting strategies on GPT-4o: a zero-shot baseline, Compositional Chain-of-Thought (CCoT) for vision-language reasoning, and a persona-driven prompt. We study seven app development projects across two countries and interview developers about the results. Overall, we observed that the baseline prompt favours recall over precision, whereas CCoT is more balanced, achieving average F1 scores of 52-66% for epics and user stories. Tasks were more challenging to generate accurately. Precision gains were most consistent when adding architectural context, particularly for backend tasks (precision gains up to 35%). Interviews with developers revealed that up to 26% of false positives were still considered useful, reflecting the creative and open-ended nature of backlog creation. To capture this, we propose a new measure called Revised Recall, which complements ground-truth evaluation with developer assessments. Our findings suggest that hybrid prompting with architectural context can assist backlog generation from early mockups, though results vary by item type and developer oversight remains necessary.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。