arXiv:2512.05967cs.IRcs.AI2025-12被引 1

用实体链接提升教育问答的准确性

Enhancing Retrieval-Augmented Generation with Entity Linking for Educational Platforms

  • 结合维基数据实体链接,用事实信号优化检索
  • 在意大利语教育数据集上显著提升准确率
  • 适合需要高可靠性的教育类AI系统使用

大型语言模型时代,检索增强生成(RAG)架构因其能基于可信知识源生成内容而备受关注。然而,仅依赖语义相似性的RAG系统在专业领域常因术语歧义导致事实错误。本文提出ELERAG,一种融合维基数据实体链接的事实信号增强型RAG架构,用于提升意大利语教育问答系统的准确性。系统包含基于Wikidata的实体链接模块,并采用基于倒数排名融合(RRF)的混合重排序策略。在自建学术数据集和标准SQuAD-it数据集上的实验表明,在领域特定场景下,ELERAG显著优于基线和独立交叉编码器配置;而在通用领域数据集上,交叉编码器表现最佳。结果验证了领域不匹配效应,强调需采用领域适配的混合策略以提升教育RAG系统的事实精确性,且无需依赖计算开销大的跨分布训练模型。研究还展示了实体感知RAG在教育环境中的潜力,助力构建可适应、可靠的AI辅导工具。

原文摘要 · Abstract (English)

In the era of Large Language Models (LLMs), Retrieval-Augmented Generation (RAG) architectures are gaining significant attention for their ability to ground language generation in reliable knowledge sources. Despite their effectiveness, RAG systems based solely on semantic similarity often fail to ensure factual accuracy in specialized domains, where terminological ambiguity can affect retrieval relevance. This study proposes ELERAG, an enhanced RAG architecture that integrates a factual signal derived from Entity Linking to improve the accuracy of educational question-answering systems in Italian. The system includes a Wikidata-based Entity Linking module and implements a hybrid re-ranking strategy based on Reciprocal Rank Fusion (RRF). To validate our approach, we compared it against standard baselines and state-of-the-art methods, including a Weighted-Score Re-ranking, a standalone Cross-Encoder and a combined RRF+Cross-Encoder pipeline. Experiments were conducted on two benchmarks: a custom academic dataset and the standard SQuAD-it dataset. Results show that, in domain-specific contexts, ELERAG significantly outperforms both the baseline and the Cross-Encoder configurations. Conversely, the Cross-Encoder approaches achieve the best results on the general-domain dataset. These findings provide strong experimental evidence of the domain mismatch effect, highlighting the importance of domain-adapted hybrid strategies to enhance factual precision in educational RAG systems without relying on computationally expensive models trained on disparate data distributions. They also demonstrate the potential of entity-aware RAG systems in educational environments, fostering adaptive and reliable AI-based tutoring tools.

教育AIRAG实体链接

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。