用Transformer模型提升灾难推文分类准确率,助力应急响应
Comparative Analysis of Transformer Models in Disaster Tweet Classification for Public Safety
- 采用BERT等变压器模型捕捉推文上下文语义
- BERT达到91%准确率,远超传统模型的82%
- 适合需要精准理解非正式语言的公共安全场景
Twitter等社交媒体在灾害与公共安全紧急事件中已成为实时信息的重要来源。自动分类灾情相关推文可帮助应急机构更快、更有效地响应。传统机器学习模型如逻辑回归、朴素贝叶斯和支持向量机虽被广泛使用,但难以理解语言的上下文或深层含义,尤其当语言非正式、隐喻或模糊时。本文提出,在此背景下,基于Transformer的模型可能优于传统方法。我们评估了BERT、DistilBERT、RoBERTa和DeBERTa等模型在灾情推文分类中的表现,并与传统机器学习方法对比。实验结果表明,BERT达到最高准确率(91%),显著优于逻辑回归和朴素贝叶斯(均为82%)。上下文嵌入与注意力机制使变压器模型能更好理解推文中细微的语言特征,而传统模型在此方面表现不足。研究证明,变压器架构在公共安全应用中更具优势,具备更高的准确性、更深入的语言理解能力以及更强的真实社交媒体文本泛化能力。
原文摘要 · Abstract (English)
Twitter and other social media platforms have become vital sources of real time information during disasters and public safety emergencies. Automatically classifying disaster related tweets can help emergency services respond faster and more effectively. Traditional Machine Learning (ML) models such as Logistic Regression, Naive Bayes, and Support Vector Machines have been widely used for this task, but they often fail to understand the context or deeper meaning of words, especially when the language is informal, metaphorical, or ambiguous. We posit that, in this context, transformer based models can perform better than traditional ML models. In this paper, we evaluate the effectiveness of transformer based models, including BERT, DistilBERT, RoBERTa, and DeBERTa, for classifying disaster related tweets. These models are compared with traditional ML approaches to highlight the performance gap. Experimental results show that BERT achieved the highest accuracy (91%), significantly outperforming traditional models like Logistic Regression and Naive Bayes (both at 82%). The use of contextual embeddings and attention mechanisms allows transformer models to better understand subtle language in tweets, where traditional ML models fall short. This research demonstrates that transformer architectures are far more suitable for public safety applications, offering improved accuracy, deeper language understanding, and better generalization across real world social media text.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。