用大模型分析飞行安全事件,让飞行员操作行为原因变得可解释。
Can Large Language Models Explain Flight Safety Events? A Prior-Guided Semantic LLM-based Approach

- 通过语义离散化将飞行数据转为语言可理解的描述。
- 结合统计模型提升分类能力,准确率超基线12.3%。
- 适合航空安全研究者和飞行数据分析人员使用。
利用飞行数据提升飞行安全,不仅需要准确检测风险事件,更关键的是在飞行员操作行为层面清晰解释其根本原因。现有可解释AI技术如特征重要性图谱,通常需大量领域知识才能转化为实际操作意义的解释。大语言模型(LLMs)擅长语言推理,为此提供了新可能。但应用于该领域仍面临模态不一致、分类能力弱、任务特定数据稀缺及领域知识缺失等挑战。为此,我们提出FlightLLM——一种先验引导的语义式大模型方法,用于可解释的飞行安全分析。首先通过特征工程解决模态不一致问题,融合统计特征与物理有意义的飞行指标;再经语义离散化模块将抽象数值模式转换为更符合语言推理的定性描述。由于LLMs本身分类能力有限,引入CatBoost作为统计专家,将其预测结果作为先验注入提示词。采用对比少样本学习策略弥补数据不足。最后设计结构化提示词,嵌入航空领域知识。以复杂因果机制的硬着陆事件为例,在704个真实A320飞行样本上评估,结果表明该方法在保持竞争性分类性能的同时,能生成直接且合理的事件原因解释。
原文摘要 · Abstract (English)
Improving flight safety with flight data requires not only accurate detection of risk events, but more importantly, clear interpretation of their underlying causes at the level of pilot control behavior. Existing explainable AI techniques, such as feature importance maps, often require considerable domain knowledge to translate them into operationally meaningful explanations. Large Language Models (LLMs), which excel at language reasoning, bring a promising solution to this issue. However, applying LLMs in this domain presents key challenges such as modal inconsistency, limited classification ability, scarcity of task-specific data for fine-tuning, and lack of domain knowledge. To overcome these challenges, we propose FlightLLM, a prior-guided semantic LLM-based approach for interpretable flight safety analysis. Specifically, we first perform feature engineering to address modal inconsistency, combining statistical descriptors with physically meaningful flight indicators. This representation is further processed by a Semantic Discretization module, which converts abstract numerical patterns into qualitative descriptions that are more compatible with language reasoning. In addition, since LLMs are not inherently strong classifiers, CatBoost is incorporated as a statistical expert, and its prediction results are injected into the prompt as prior guidance. A contrastive few-shot learning strategy is further adopted to compensate for limited data. Finally, we design structured prompts to embed aviation-specific knowledge into the inference process. Using hard landing, a representative risk event with complex causal mechanisms, as an anchor point, we evaluate FlightLLM on a dataset of 704 real-world A320 flight samples. Experimental results show that the proposed approach achieves competitive classification performance while generating direct and reasonable explanations for event causes.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。