用自进化框架让大模型读懂飞行通告,提升航空安全决策效率
NOTAM-Evolve: A Knowledge-Guided Self-Evolving Optimization Framework with LLMs for NOTAM Interpretation
- 构建闭环学习机制,让大模型从自身输出中持续优化
- 在1万条专家标注数据上实现30.4%准确率提升
- 适合航空智能系统研发者与安全运维人员参考
飞行通告(NOTAM)的准确解读对航空安全至关重要,但其简略晦涩的语言给人工和自动化处理带来挑战。现有系统多限于浅层解析,难以提取可操作情报。本文将完整解读任务定义为深度解析,需同时实现动态知识定位(关联实时航务数据)与结构化推理(应用静态领域规则推断运行状态)。为此提出NOTAM-Evolve框架,通过知识图谱增强检索模块实现数据锚定,并引入闭环学习过程,使大模型能自主优化,减少对人工标注推理轨迹的依赖。同时构建了包含10,000条专家标注样本的新基准数据集。实验表明,NOTAM-Evolve相较基础大模型实现30.4%的绝对准确率提升,在结构化飞行通告解读任务上达到新最佳性能。
原文摘要 · Abstract (English)
Accurate interpretation of Notices to Airmen (NOTAMs) is critical for aviation safety, yet their condensed and cryptic language poses significant challenges to both manual and automated processing. Existing automated systems are typically limited to shallow parsing, failing to extract the actionable intelligence needed for operational decisions. We formalize the complete interpretation task as deep parsing, a dual-reasoning challenge requiring both dynamic knowledge grounding (linking the NOTAM to evolving real-world aeronautical data) and schema-based inference (applying static domain rules to deduce operational status). To tackle this challenge, we propose NOTAM-Evolve, a self-evolving framework that enables a large language model (LLM) to autonomously master complex NOTAM interpretation. Leveraging a knowledge graph-enhanced retrieval module for data grounding, the framework introduces a closed-loop learning process where the LLM progressively improves from its own outputs, minimizing the need for extensive human-annotated reasoning traces. In conjunction with this framework, we introduce a new benchmark dataset of 10,000 expert-annotated NOTAMs. Our experiments demonstrate that NOTAM-Evolve achieves a 30.4% absolute accuracy improvement over the base LLM, establishing a new state of the art on the task of structured NOTAM interpretation.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。