针对数据不平衡问题,提出更鲁棒的新型支持向量机模型。
Robust Universum Twin Support Vector Machine for Imbalanced Data
- 引入直觉模糊隶属度机制,减轻噪声与异常值影响。
- 结合正则化项实现结构风险最小化,有效防止过拟合。
- 在医学诊断数据上表现优异,适合不平衡数据场景。
机器学习中处理不平衡数据集是一大挑战,易导致模型偏向多数类,使少数类识别效果差。传统通用对偶支持向量机(UTSVM)在处理含噪声和异常值的数据时性能不佳,且因未考虑结构风险最小化(SRM)原则而存在过拟合风险。为此,本文提出直觉模糊UTSVM-ID(IFUTSVM-ID),通过引入直觉模糊隶属度机制降低噪声影响,并结合数据过采样与欠采样策略应对类别分布不均问题。利用先验知识(通过通用数据提供)提升泛化能力。同时,模型嵌入正则化项以实现SRM原则,显著缓解过拟合。在KEEL基准数据集及阿尔茨海默病神经影像计划(ADNI)数据集上的实验表明,该模型优于现有基线方法。
原文摘要 · Abstract (English)
One of the major difficulties in machine learning methods is categorizing datasets that are imbalanced. This problem may lead to biased models, where the training process is dominated by the majority class, resulting in inadequate representation of the minority class. Universum twin support vector machine (UTSVM) produces a biased model towards the majority class, as a result, its performance on the minority class is often poor as it might be mistakenly classified as noise. Moreover, UTSVM is not proficient in handling datasets that contain outliers and noises. Inspired by the concept of incorporating prior information about the data and employing an intuitionistic fuzzy membership scheme, we propose intuitionistic fuzzy UTSVM for imbalanced data (IFUTSVM-ID) by enhancing overall robustness. We use an intuitionistic fuzzy membership scheme to mitigate the impact of noise and outliers. Moreover, to tackle the problem of imbalanced class distribution, data oversampling and undersampling methods are utilized. Prior knowledge about the data is provided by universum data. This leads to better generalization performance. UTSVM is susceptible to overfitting risks due to the omission of the structural risk minimization (SRM) principle in their primal formulations. However, the proposed IFUTSVM-ID model incorporates the SRM principle through the incorporation of regularization terms, effectively addressing the issue of overfitting. We conduct a comprehensive evaluation of the proposed IFUTSVM-ID model on benchmark datasets from KEEL and compare it with existing baseline models. Furthermore, to assess the effectiveness of the proposed IFUTSVM-ID model in diagnosing Alzheimer's disease (AD), we applied them to the Alzheimer's Disease Neuroimaging Initiative (ADNI) dataset. Experimental results showcase the superiority of the proposed IFUTSVM-ID models compared to the baseline models.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。