用大模型提升航空培训精准度,解决答案错误和知识过时问题。
AviationLLM: An LLM-based Knowledge System for Aviation Training
- 结合检索增强与直接偏好优化,对大模型进行领域对齐。
- 在航空知识问答中准确率显著提升,支持零成本更新知识。
- 适合航空培训机构、飞行教员及需要专业培训的从业者。
航空培训是保障飞行安全、提升行业效率和促进可持续发展的关键环节,不仅涉及飞行模拟,还需掌握大量专业航空理论知识。当前培训体系主要依赖导师传授,但师资有限,且网络获取的专业回答准确性不足,导致培训效率低下。为此,本文引入大语言模型(LLM),但基础预训练模型难以提供专业领域精确回答,因此采用微调策略。传统监督微调(SFT)因数据覆盖不足,易生成看似合理实则错误的回答。为此,本文提出基于直接偏好优化(DPO)的检索增强型大模型对齐方法(RALA-DPO)。选用开源预训练模型Qwen,通过DPO实现航空理论领域的模型对齐。同时,为缓解训练数据偏差、知识过时或领域知识缺失导致的幻觉问题,引入检索增强生成(RAG)技术,融合生成与检索模型。RALA-DPO能从外部知识库有效检索相关信息,并通过生成模型输出精准高质量的回答。实验表明,该系统显著提升专业航空知识问答的准确性;集成RAG机制后,答案准确率进一步提高,且可实现零成本的知识更新。
原文摘要 · Abstract (English)
Aviation training is a core link in ensuring flight safety, improving industry efficiency and promoting sustainable development. It not only involves flight simulation but also requires the learning of a great deal of professional aviation theory knowledge. In the existing training system, the knowledge is mainly imparted by the the instructors. However, the number of instructors is limited and the professional answers obtained from the Internet are not accurate enough, resulting in low training efficiency. To address this, we introduced LLM, but the basic pre-trained model cannot provide accurate answers to professional fields, so we fine-tuned it. Traditional Supervised Fine-Tuning (SFT) risk generating superficially plausible but factually incorrect responses due to insufficient data coverage. To address this, we employ Direct Preference Optimization(DPO). This paper proposes Retrieval-Augmented LLM Alignment via Direct Preference Optimization(RALA-DPO). We select open source pre-trained LLM Qwen and adapt it to aviation theory training through DPO-based domain alignment. Simultaneously, to mitigate hallucinations caused by training data biases, knowledge obsolescence, or domain knowledge gaps, we implement Retrieval-Augmented Generation(RAG) technology that combines generative and retrieval models. RALA-DPO effectively retrieves relevant information from external knowledge bases and delivers precise and high-quality responses through the generative model. Experimental results demonstrate that RALA-DPO can improve accuracy in response to professional aviation knowledge. With integrated RAG mechanisms, this system can further improve the accuracy of answers and achieve zero-cost knowledge updates simultaneously.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。