arXiv:2409.08406cs.CLcs.AI2024-09AAAI被引 9

用大模型多智能体系统自动标注题目知识点,提升教育智能应用精准度。

Knowledge Tagging with Large Language Model based Multi-Agent System

  • 构建大模型驱动的多智能体协作系统,分工处理题目理解与知识匹配。
  • 在MathKnowCT数据集上表现优于传统方法,尤其擅长处理复杂数学题。
  • 适合教育AI研发者、智能题库开发者参考,推动自动化知识标注落地。

题目知识点标注在现代智能教育应用中至关重要,涵盖学习进度诊断、习题推荐和课程内容组织。传统上依赖教学专家完成,因任务需深刻理解题干语义与知识定义,并准确关联解题逻辑与知识点。随着预训练语言模型和大语言模型(LLMs)的发展,已有研究尝试用机器学习模型实现自动化标注。本文探讨基于多智能体系统的方案,以解决以往算法在处理复杂知识定义和严格数值约束时的局限性。通过在公开的数学题知识点标注数据集MathKnowCT上的实证,验证了该方法在复杂案例中的优越性能,凸显了大模型多智能体系统在克服先前技术瓶颈方面的巨大潜力。最后,通过对自动化标注意义的深入讨论,强调了大模型算法在教育场景部署中的前景。

原文摘要 · Abstract (English)

Knowledge tagging for questions is vital in modern intelligent educational applications, including learning progress diagnosis, practice question recommendations, and course content organization. Traditionally, these annotations have been performed by pedagogical experts, as the task demands not only a deep semantic understanding of question stems and knowledge definitions but also a strong ability to link problem-solving logic with relevant knowledge concepts. With the advent of advanced natural language processing (NLP) algorithms, such as pre-trained language models and large language models (LLMs), pioneering studies have explored automating the knowledge tagging process using various machine learning models. In this paper, we investigate the use of a multi-agent system to address the limitations of previous algorithms, particularly in handling complex cases involving intricate knowledge definitions and strict numerical constraints. By demonstrating its superior performance on the publicly available math question knowledge tagging dataset, MathKnowCT, we highlight the significant potential of an LLM-based multi-agent system in overcoming the challenges that previous methods have encountered. Finally, through an in-depth discussion of the implications of automating knowledge tagging, we underscore the promising results of deploying LLM-based algorithms in educational contexts.

知识标注多智能体教育AI大模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。