arXiv:2505.07618cs.IR2025-05被引 6

用知识图谱和认知理论生成可调难度的教育题,提升测评科学性。

KAQG: A Knowledge-Graph-Enhanced RAG for Difficulty-Controlled Question Generation

  • 融合认知理论与知识图谱,实现题目难度精细控制。
  • 在台湾环保研究院部署,显著降低人工出题量,提升测评可靠性。
  • 适合教育评估、职业认证等需要科学命题的场景。

本研究提出知识增强型问答生成框架KAQG,将项目反应理论(IRT)、布卢姆分类学与知识图谱融入多智能体检索增强生成系统。该方法突破现有技术局限,实现题目难度细粒度调控、心理测量校准与认知层次对齐。通过多图隔离保留领域语义,采用分布式代理架构(基于数据分发服务DDS)保障系统可扩展与容错性。各智能体专精于检索、生成或评估任务,构成模块化可追溯流程。框架直接将语义层级、基于PageRank的概念权重及评估理论参数嵌入生成过程,确保问题兼具上下文相关性与认知合理性。已在台湾国家环境研究院部署,实际应用中显著减少人工工作量,提升测评信度与效度,并支持自适应与标准化评估。该研究通过整合心理测量学与AI驱动的检索生成,为教育评估与职业认证提供可扩展的认知对齐解决方案。

原文摘要 · Abstract (English)

This study introduces Knowledge Augmented Question Generation (KAQG), an educational assessment framework that integrates Item Response Theory, abbreviated as IRT, Bloom's Taxonomy, and knowledge graphs into a multi-agent Retrieval-Augmented Generation (RAG) system. The proposed approach overcomes limitations of existing methods by enabling fine-grained control over item difficulty, psychometric calibration, and cognitive alignment. It employs multi-graph isolation to preserve domain-specific semantics and leverages a distributed agent architecture coordinated through Data Distribution Service, abbreviated as DDS, for scalable and fault-tolerant operations. Each agent specializes in tasks such as retrieval, generation, or evaluation, forming a modular and traceable pipeline. Distinctively, the framework encodes semantic hierarchies, PageRank-based concept weighting, and assessment-theory parameters directly into the generation process, ensuring that questions are both contextually grounded and cognitively calibrated. Deployed at Taiwan's National Institute of Environmental Research, the system has demonstrated practical value by reducing manual workload, improving reliability and validity, and supporting both adaptive and standardized assessments. By integrating psychometric theory with AI-driven retrieval and generation, this work establishes a scalable and cognitively aligned solution for education and professional certification.

教育AI知识图谱智能出题

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。