用知识图谱增强AI问答,让网络安全教育更可靠
Ontology-Aware RAG for Improved Question-Answering in Cybersecurity Education
- 结合知识图谱检索网络安全文档,提升回答准确性
- 在公开数据集上验证,回答与领域知识高度一致
- 适合需要精准答案的网络安全教学场景
将AI融入教育有望革新科技类课程教学,尤其在网络安全领域。基于大语言模型的问答系统能主动处理不确定性,提供互动式探究学习体验。然而,这类系统常出现幻觉和领域知识不足问题,影响教育场景下的可靠性。为此,我们提出CyberRAG——一种面向网络安全教育的本体感知检索增强生成方法。该方法分两步:首先从知识库中检索经验证的网络安全文档,增强回答的相关性与准确性;其次通过知识图谱本体验证最终答案,减少幻觉和误用。在公开数据集上的全面实验表明,CyberRAG能生成与领域知识一致的准确、可靠回答,展现出AI工具在教育中的潜力。
原文摘要 · Abstract (English)
Integrating AI into education has the potential to transform the teaching of science and technology courses, particularly in the field of cybersecurity. AI-driven question-answering (QA) systems can actively manage uncertainty in cybersecurity problem-solving, offering interactive, inquiry-based learning experiences. Recently, Large language models (LLMs) have gained prominence in AI-driven QA systems, enabling advanced language understanding and user engagement. However, they face challenges like hallucinations and limited domain-specific knowledge, which reduce their reliability in educational settings. To address these challenges, we propose CyberRAG, an ontology-aware retrieval-augmented generation (RAG) approach for developing a reliable and safe QA system in cybersecurity education. CyberRAG employs a two-step approach: first, it augments the domain-specific knowledge by retrieving validated cybersecurity documents from a knowledge base to enhance the relevance and accuracy of the response. Second, it mitigates hallucinations and misuse by integrating a knowledge graph ontology to validate the final answer. Comprehensive experiments on publicly available datasets reveal that CyberRAG delivers accurate, reliable responses aligned with domain knowledge, demonstrating the potential of AI tools to enhance education.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。