arXiv:2510.22318cs.SEcs.AI2025-10

用大模型辅助软件测试教学,提升ISTQB认证学习效果。

Harnessing the Power of Large Language Models for Software Testing Education: A Focus on ISTQB Syllabus

  • 构建覆盖十年的ISTQB题库,含28套试卷1145道题。
  • 优化提示词使大模型答题更准、解释更清晰。
  • 验证主流大模型在测试题上的表现,给出教学应用建议。

软件测试是软件工程的核心环节,对教育领域至关重要。国际软件测试资质委员会(ISTQB)认证在全球范围内被广泛采用,但其教学方法尚未充分结合生成式人工智能的发展。本文探索并评估大语言模型(LLMs)如何补充高等教育中的ISTQB教学体系。研究提出四项关键成果:(i) 构建涵盖十余年、包含28套样卷和1,145道题的全面ISTQB对齐数据集;(ii) 开发面向领域优化的提示词,显著提升LLM在ISTQB任务中的精度与解释质量;(iii) 系统评估当前领先大模型在此数据集上的表现;(iv) 提出将大模型融入软件测试教育的具体建议。结果表明,大模型在支持ISTQB认证备考方面具有巨大潜力,并为未来在高等教育中推广其应用奠定基础。

原文摘要 · Abstract (English)

Software testing is a critical component in the software engineering field and is important for software engineering education. Thus, it is vital for academia to continuously improve and update educational methods to reflect the current state of the field. The International Software Testing Qualifications Board (ISTQB) certification framework is globally recognized and widely adopted in industry and academia. However, ISTQB-based learning has been rarely applied with recent generative artificial intelligence advances. Despite the growing capabilities of large language models (LLMs), ISTQB-based learning and instruction with LLMs have not been thoroughly explored. This paper explores and evaluates how LLMs can complement the ISTQB framework for higher education. The findings present four key contributions: (i) the creation of a comprehensive ISTQB-aligned dataset spanning over a decade, consisting of 28 sample exams and 1,145 questions; (ii) the development of a domain-optimized prompt that enhances LLM precision and explanation quality on ISTQB tasks; (iii) a systematic evaluation of state-of-the-art LLMs on this dataset; and (iv) actionable insights and recommendations for integrating LLMs into software testing education. These findings highlight the promise of LLMs in supporting ISTQB certification preparation and offer a foundation for their broader use in software engineering at higher education.

大模型软件测试教育ISTQB

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。