arXiv:2501.01227cs.LG2025-01被引 8

用四种主题模型分析航空事故文本,发现各方法优劣。

Comparative Analysis of Topic Modeling Techniques on ATSB Text Narratives Using Natural Language Processing

  • 对比pLSA、LSA、LDA、NMF四类主题模型在事故文本中的表现。
  • 揭示各模型提取隐含主题的能力差异,为安全分析提供依据。
  • 适合从事航空安全、文本挖掘的研究者参考。

航空安全分析的进步需要创新技术来从大量事故报告的文本数据中提取有价值的信息。本文探讨了四种主流主题建模技术——概率潜在语义分析(pLSA)、潜在语义分析(LSA)、潜在狄利克雷分配(LDA)和非负矩阵分解(NMF)——在澳大利亚运输安全局(ATSB)数据集上的应用。研究分析了每种方法揭示数据中潜在主题结构的能力,为安全专业人员提供系统化手段以获取可行动的洞察。通过对比分析,本研究不仅展示了这些方法在航空安全中的潜力,还阐明了它们各自的优缺点。

原文摘要 · Abstract (English)

Improvements in aviation safety analysis call for innovative techniques to extract valuable insights from the abundance of textual data available in accident reports. This paper explores the application of four prominent topic modelling techniques, namely Probabilistic Latent Semantic Analysis (pLSA), Latent Semantic Analysis (LSA), Latent Dirichlet Allocation (LDA), and Non-negative Matrix Factorization (NMF), to dissect aviation incident narratives using the Australian Transport Safety Bureau (ATSB) dataset. The study examines each technique's ability to unveil latent thematic structures within the data, providing safety professionals with a systematic approach to gain actionable insights. Through a comparative analysis, this research not only showcases the potential of these methods in aviation safety but also elucidates their distinct advantages and limitations.

主题模型航空安全文本分析

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。