arXiv:2503.12239cs.LGcs.AI2025-03被引 1

针对乳腺癌诊断数据不平衡问题,提出双阶段优化的增广方法

A Novel Double Pruning method for Imbalanced Data using Information Entropy and Roulette Wheel Selection for Breast Cancer Diagnosis

  • 用信息熵筛选+轮盘赌选择,在边界重叠区生成高质量样本
  • 相比顶尖算法准确率提升3.22%,方差降低88.8%
  • 适合医疗数据稀缺、样本不平衡场景下的分类模型训练

精准疾病诊断对治疗有效性和患者安全至关重要。机器学习模型常基于历史医疗数据进行癌症诊断,但数据不平衡仍是主要挑战,影响分类器性能与可靠性。SMOTEBoost通过生成合成数据平衡数据集,但可能忽略决策边界的重叠区域,并产生噪声样本。本文提出RE-SMOTEBoost,为改进此问题:首先,采用轮盘赌选择在重叠区域生成合成样本,更好捕捉决策边界;其次,引入基于信息熵的过滤机制,剔除噪声及边缘样本,提升生成数据质量;第三,设计双重正则化惩罚项,控制合成样本与决策边界的距离,避免类别重叠。这些改进实现更高质量的少数类过采样,构建更均衡有效的训练集。在不平衡数据集上的实验表明,该方法优于现有先进算法,准确率提升3.22%,方差降低88.8%。结果表明,该模型可有效应对因样本稀缺、采集困难和隐私限制导致的医疗数据短缺与严重失衡问题。

原文摘要 · Abstract (English)

Accurate illness diagnosis is vital for effective treatment and patient safety. Machine learning models are widely used for cancer diagnosis based on historical medical data. However, data imbalance remains a major challenge, leading to hindering classifier performance and reliability. The SMOTEBoost method addresses this issue by generating synthetic data to balance the dataset, but it may overlook crucial overlapping regions near the decision boundary and can produce noisy samples. This paper proposes RE-SMOTEBoost, an enhanced version of SMOTEBoost, designed to overcome these limitations. Firstly, RE-SMOTEBoost focuses on generating synthetic samples in overlapping regions to better capture the decision boundary using roulette wheel selection. Secondly, it incorporates a filtering mechanism based on information entropy to reduce noise, and borderline cases and improve the quality of generated data. Thirdly, we introduce a double regularization penalty to control the synthetic samples proximity to the decision boundary and avoid class overlap. These enhancements enable higher-quality oversampling of the minority class, resulting in a more balanced and effective training dataset. The proposed method outperforms existing state-of-the-art techniques when evaluated on imbalanced datasets. Compared to the top-performing sampling algorithms, RE-SMOTEBoost demonstrates a notable improvement of 3.22\% in accuracy and a variance reduction of 88.8\%. These results indicate that the proposed model offers a solid solution for medical settings, effectively overcoming data scarcity and severe imbalance caused by limited samples, data collection difficulties, and privacy constraints.

数据增强不平衡学习医疗诊断信息熵

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。