arXiv:2501.16276cs.CLcs.IR2025-01被引 11

URAG框架提升招生问答准确率,低成本实现精准回答

URAG: Implementing a Unified Hybrid RAG for Precise Answers in University Admission Chatbots -- A Case Study at HCMUT

  • 融合检索与生成的混合方法,无需复杂训练
  • 轻量模型性能逼近顶级商业系统
  • 已在真实高校场景落地,效果获好评

随着人工智能尤其是自然语言处理的发展,大型语言模型(LLMs)在大学招生聊天机器人等教育问答系统中发挥关键作用。检索增强生成(RAG)等技术通过整合特定高校数据,使LLM能针对招生与学术咨询提供更准确的回答。然而,现有RAG方法常伴随高运营成本,并需训练复杂的专用模块,限制实际部署。此外,教育场景中准确性至关重要,而纯LLM系统易产生误导性信息。本文提出统一混合RAG框架(URAG),显著提升关键问题的回答精度。实验表明,该框架使我们自研的轻量级模型表现接近当前最先进的商用模型。为验证实用性,我们在本校开展案例研究,获得积极反馈。本研究不仅证明了URAG的有效性,也展示了其在真实教育场景中的可实施性。

原文摘要 · Abstract (English)

With the rapid advancement of Artificial Intelligence, particularly in Natural Language Processing, Large Language Models (LLMs) have become pivotal in educational question-answering systems, especially university admission chatbots. Concepts such as Retrieval-Augmented Generation (RAG) and other advanced techniques have been developed to enhance these systems by integrating specific university data, enabling LLMs to provide informed responses on admissions and academic counseling. However, these enhanced RAG techniques often involve high operational costs and require the training of complex, specialized modules, which poses challenges for practical deployment. Additionally, in the educational context, it is crucial to provide accurate answers to prevent misinformation, a task that LLM-based systems find challenging without appropriate strategies and methods. In this paper, we introduce the Unified RAG (URAG) Framework, a hybrid approach that significantly improves the accuracy of responses, particularly for critical queries. Experimental results demonstrate that URAG enhances our in-house, lightweight model to perform comparably to state-of-the-art commercial models. Moreover, to validate its practical applicability, we conducted a case study at our educational institution, which received positive feedback and acclaim. This study not only proves the effectiveness of URAG but also highlights its feasibility for real-world implementation in educational settings.

RAG招生问答轻量模型教育AI

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。