用知识图谱+大模型混合架构,让教育技能搜索更准更快
KG-First, LLM-Fallback: A Hybrid Microservice for Grounded Skill Search and Explanation
- 先用知识图谱精准匹配技能,再用大模型生成解释
- 检索准确率nDCG@5超0.94,响应时间小于200毫秒
- 适合需要可解释、高可信度技能推荐的教育平台
权威能力框架如ESCO、ROME和O*NET对教育与就业对接至关重要,但其技术复杂性和结构异质性阻碍了教育者使用。本文提出SkillGraph-Service,一个可互操作的微服务,将这些资源统一为保留来源的知识图谱(KG)。采用KG-first、LLM-fallback架构,结合符号逻辑与非符号灵活性。设计轻量级混合检索引擎(融合SQLite FTS5与HNSW向量搜索),解决教育者查询中的词汇不匹配问题;仅在受限排名和受众感知解释中使用大语言模型(LLMs)。在多语言数据集上的实证评估显示,该混合策略实现优异检索效果(nDCG@5>0.94),延迟低于200毫秒,表明此领域无需计算昂贵的交叉编码重排序。此外,生成解释分析揭示流畅性与忠实性间的权衡:虽JSON约束的LLMs保证高引用精确度,但确定性模板仍是证据覆盖最可靠的手段。该架构为复杂技能数据集成到数字学习生态提供了实用、可扩展且可审计的解决方案。
原文摘要 · Abstract (English)
Authoritative competency frameworks such as ESCO, ROME, and O*NET are essential for aligning education with labor market needs, yet their technical complexity and structural heterogeneity hinder practical adoption by educators. This paper introduces SkillGraph-Service, an interoperable microservice designed to bridge this gap by unifying these resources into a provenance-preserving Knowledge Graph (KG). Adopting a KG-first, LLM-fallback architecture, the system combines symbolic rigor with sub-symbolic flexibility. It implements a lightweight hybrid retrieval engine (fusing SQLite FTS5 and HNSW vector search) to handle the vocabulary mismatch in educator queries, and utilizes Large Language Models (LLMs) strictly for constrained ranking and audience-aware explanation. Empirical evaluation on a multilingual dataset reveals that the proposed hybrid strategy achieves superior retrieval effectiveness (nDCG@5>0.94) with sub-200 ms latency, rendering computationally expensive cross-encoder re-ranking may be unnecessary for this domain. Furthermore, an analysis of generated explanations highlights a trade-off between fluency and faithfulness: while JSON-constrained LLMs ensure high citation precision, deterministic templates remain the most reliable method for maximizing evidence coverage. The resulting architecture offers a practical, scalable, and auditable solution for integrating complex skill data into digital learning ecosystems.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。