用ChatGPT生成测试用例,效果接近人工但需人类把关。
WIP: Assessing the Effectiveness of ChatGPT in Preparatory Testing Activities
- 学生用提示词让ChatGPT生成测试文档,对比人工成果。
- AI可自动化多数准备任务,但质量仍逊于人类专家。
- 适合已具备IT背景的高年级学生,渐进式引入教学。
本研究在北美社区学院的一门毕业项目课程中,探索将ChatGPT融入软件测试教学的效果。学生使用此前手动创建的提示词,让ChatGPT生成预备测试用例,并通过针对性问题评估其理解程度与生成成果的有效性。结果表明,尽管ChatGPT能自动完成大量测试准备工作,但无法完全替代人类专业判断。然而,已有信息技术背景的研究生水平学生发现,将ChatGPT融入工作流非常简便。研究建议应逐步将人工智能引入软件测试教育,以跟上技术发展步伐。
原文摘要 · Abstract (English)
This innovative practice WIP paper describes a research study that explores the integration of ChatGPT into the software testing curriculum and evaluates its effectiveness compared to human-generated testing artifacts. In a Capstone Project course, students were tasked with generating preparatory testing artifacts using ChatGPT prompts, which they had previously created manually. Their understanding and the effectiveness of the Artificial Intelligence generated artifacts were assessed through targeted questions. The results, drawn from this in-class assignment at a North American community college indicate that while ChatGPT can automate many testing preparation tasks, it cannot fully replace human expertise. However, students, already familiar with Information Technology at the postgraduate level, found the integration of ChatGPT into their workflow to be straightforward. The study suggests that AI can be gradually introduced into software testing education to keep pace with technological advancements.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。