用符号逻辑约束神经网络,让航空安全报告分类更可靠。
NASP-T: A Fuzzy Neuro-Symbolic Transformer for Logic-Constrained Aviation Safety Report Classification
- 结合程序逻辑与变压器模型,用规则生成合理文本样本。
- 测试集规则违反率降低86%,准确率显著提升。
- 适合需要高可信度的航空、医疗等安全关键领域。
深度变换器模型在多标签文本分类中表现优异,但在安全关键应用中常违背专家认为至关重要的领域逻辑。本文提出一种混合神经-符号框架,将答案集编程(ASP)与基于ASRS语料库的变换器学习相结合。领域知识以加权ASP规则形式建模,并通过Clingo求解器验证。这些规则以两种互补方式融入:(i) 作为基于规则的数据增强,生成逻辑一致的合成样本,提升标签多样性和覆盖率;(ii) 作为模糊逻辑正则项,在微调过程中以可微形式强制规则满足。该设计在保持符号推理可解释性的同时,利用深度神经架构的可扩展性。我们进一步优化每类阈值,并报告标准分类指标和逻辑一致性率。相较于强基线二元交叉熵模型,本方法在微平均和宏平均F1得分上均有所提升,且在ASRS测试集上规则违反率最高降低86%。据我们所知,这是首个大规模应用于ASRS报告的神经符号系统,首次统一了基于ASP的推理、规则驱动增强与可微变换器训练,为可信安全关键NLP提供新范式。
原文摘要 · Abstract (English)
Deep transformer models excel at multi-label text classification but often violate domain logic that experts consider essential, an issue of particular concern in safety-critical applications. We propose a hybrid neuro-symbolic framework that integrates Answer Set Programming (ASP) with transformer-based learning on the Aviation Safety Reporting System (ASRS) corpus. Domain knowledge is formalized as weighted ASP rules and validated using the Clingo solver. These rules are incorporated in two complementary ways: (i) as rule-based data augmentation, generating logically consistent synthetic samples that improve label diversity and coverage; and (ii) as a fuzzy-logic regularizer, enforcing rule satisfaction in a differentiable form during fine-tuning. This design preserves the interpretability of symbolic reasoning while leveraging the scalability of deep neural architectures. We further tune per-class thresholds and report both standard classification metrics and logic-consistency rates. Compared to a strong Binary Cross-Entropy (BCE) baseline, our approach improves micro- and macro-F1 scores and achieves up to an 86% reduction in rule violations on the ASRS test set. To the best of our knowledge, this constitutes the first large-scale neuro-symbolic application to ASRS reports that unifies ASP-based reasoning, rule-driven augmentation, and differentiable transformer training for trustworthy, safety-critical NLP.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。