arXiv:2510.26683cs.CLcs.AI2025-10

用知识规则引导大模型自我进化,解决专业领域幻觉问题。

Evontree: Ontology Rule-Guided Self-Evolution of Large Language Models

  • 基于本体规则自动提取并修正模型知识矛盾
  • 在医疗问答任务中准确率提升最高达3.7%
  • 适合数据稀缺的专业领域如医疗法律

尽管大语言模型在通用领域表现优异,但在医疗、法律等专业领域,幻觉问题带来显著风险,且高可解释性至关重要。现有微调方法依赖大规模专业数据集,但受隐私法规限制难以获取;现有自进化方法多针对通用领域,缺乏知识约束,在知识密集型领域适应性差。本文提出基于本体规则的自进化方法 Evontree,实现低资源专业领域的模型自我演进。具体流程:首先从原始模型中提取领域本体知识,再利用两条核心本体规则检测知识不一致,最后通过自蒸馏微调强化知识缺口。在 Llama3-8B-Instruct 和 Med42-V2 医疗问答基准上的大量评估表明,Evontree 超过基础模型与强基线,准确率最高提升 3.7%。详细的消融实验进一步验证了方法的鲁棒性。

原文摘要 · Abstract (English)

Although Large Language Models (LLMs) perform exceptionally well in general domains, the problem of hallucinations poses significant risks in specialized fields such as healthcare and law, where high interpretability is essential. Existing fine-tuning methods depend heavily on large-scale professional datasets, which are often hard to obtain due to the privacy regulations. Moreover, existing self-evolution methods are primarily designed for general domains, which may struggle to adapt to knowledge-intensive domains due to the lack of knowledge constraints. In this paper, we propose an ontology rule guided method Evontree to enable self-evolution of LLMs in low-resource specialized domains. Specifically, Evontree first extracts domain ontology knowledge from raw models, then detects knowledge inconsistencies using two core ontology rules, and finally reinforces gap knowledge into model via self-distilled fine-tuning. Extensive evaluations on medical QA benchmarks using Llama3-8B-Instruct and Med42-V2 demonstrate the effectiveness of Evontree, which outperforms both the base models and strong baselines, achieving up to a 3.7\% improvement in accuracy. Detailed ablation studies further validate the robustness of our approach.

大模型知识推理医疗AI自进化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。