针对交通出行方式数据不平衡问题,提出自适应聚类增样方法提升少数类预测准确率。
Adaptive Cluster-Based Synthetic Minority Oversampling Technique for Traffic Mode Choice Prediction with Imbalanced Dataset
- 基于密度聚类识别少数类内部子群,按局部簇比例动态增样
- 在随机森林与梯度提升模型上,少数类F1分数显著优于传统方法
- 适合处理交通出行、医疗诊断等类别严重不均衡的实际场景
城市交通数据中,市民出行方式常呈现类别分布严重失衡,给数据驱动模型对少数类的分类带来挑战。现有重采样方法包括对少数类生成合成数据(过采样)或移除多数类样本(欠采样),但过采样易过度泛化密集子群,忽略稀疏区域潜在关键信息;欠采样则可能剔除某些子群体的有用信息。为此,本文提出一种自适应聚类基过采样技术:对少数类采用基于密度的空间聚类,依据输入特征识别子群,再根据各局部簇样本数与最大多数类的比例进行过采样。结合随机森林与极端梯度提升模型使用时,该方法在少数类上显著提升F1分数,实现更精准的出行方式分类。
原文摘要 · Abstract (English)
Urban datasets such as citizen transportation modes often contain disproportionately distributed classes, posing significant challenges to the classification of under-represented samples using data-driven models. In the literature, various resampling methods have been developed to create synthetic data for minority classes (oversampling) or remove samples from majority classes (undersampling) to alleviate class imbalance. However, oversampling approaches tend to overgeneralize minor classes that are closely clustered and neglect sparse regions which may contain crucial information. Conversely, undersampling methods potentially remove useful information on certain subgroups. Hence, a resampling approach that takes the inherent distribution of data into consideration is required to ensure appropriate synthetic data creation. This study proposes an adaptive cluster-based synthetic minority oversampling technique. Density-based spatial clustering is applied on minority classes to identify subgroups based on their input features. The classes in each of these subgroups are then oversampled according to the ratio of data points of their local cluster to the largest majority class. When used in conjunction with machine learning models such as random forest and extreme gradient boosting, this oversampling method results in significantly higher F1 scores for the minority classes compared to other resampling techniques. These improved models provide accurate classification of transportation modes.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。