用事故描述文本提升车祸伤情预测准确率
Predicting person-level injury severity using crash narratives: A balanced approach with roadway classification and natural language process techniques
- 结合文本分析与结构化数据,用TF-IDF和Word2Vec提取事故描述语义
- 引入近邻采样解决样本不平衡问题,使模型在多数子组中准确率超纯结构数据模型
- 适用于交通安全管理、政策制定者,可推广至不同道路分类体系
预测交通事故中人员伤亡严重程度对提升道路安全、优化应急响应和指导公共卫生干预至关重要。本研究探讨将警察现场记录的非结构化事故描述文本与结构化事故数据结合,用于预测伤情严重程度的增益。采用词频-逆文档频率(TF-IDF)和Word2Vec两种自然语言处理技术提取文本语义,并比较其效果。为应对类别不平衡问题,使用基于K近邻的过采样方法处理训练数据。数据来自肯塔基州2019至2023年的事故记录,考虑道路异质性,分别采用八类详细功能分类(如城市双车道、乡村高速公路)、四类宽泛配对类别(如城市/乡村、快速路/非快速路)以及无分类统一数据集。通过两种NLP方法与三种集成算法(XGBoost、随机森林、AdaBoost)组合,共构建102个机器学习模型。结果表明,融合文本数据的模型在多数子组中均优于仅使用结构化数据的模型;其中,TF-IDF配合XGBoost表现最优。研究证实整合文本与结构化信息能显著提升个体伤情预测能力,为交通安全管理提供可落地、可扩展的建模框架。
原文摘要 · Abstract (English)
Predicting injuries and fatalities in traffic crashes plays a critical role in enhancing road safety, improving emergency response, and guiding public health interventions. This study investigates the added value of unstructured crash narratives (written by police officers at the scene) when combined with structured crash data to predict injury severity. Two widely used Natural Language Processing (NLP) techniques, Term Frequency-Inverse Document Frequency (TF-IDF) and Word2Vec, were employed to extract semantic meaning from the narratives, and their effectiveness was compared. To address the challenge of class imbalance, a K-Nearest Neighbors-based oversampling method was applied to the training data prior to modeling. The dataset consists of crash records from Kentucky spanning 2019 to 2023. To account for roadway heterogeneity, three road classification schemes were used: (1) eight detailed functional classes (e.g., Urban Two-Lane, Rural Interstate, Urban Multilane Divided), (2) four broader paired categories (e.g., Urban vs. Rural, Freeway vs. Non-Freeway), and (3) a unified dataset without classification. A total of 102 machine learning models were developed by combining structured features and narrative-based features using the two NLP techniques alongside three ensemble algorithms: XGBoost, Random Forest, and AdaBoost. Results demonstrate that models incorporating narrative data consistently outperform those relying solely on structured data. Among all combinations, TF-IDF coupled with XGBoost yielded the most accurate predictions in most subgroups. The findings highlight the power of integrating textual and structured crash information to enhance person-level injury prediction. This work offers a practical and adaptable framework for transportation safety professionals to improve crash severity modeling, guide policy decisions, and design more effective countermeasures.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。