用不确定性指导生成,让少数类样本更真实可信。
Uncertainty-Aware Generative Oversampling Using an Entropy-Guided Conditional Variational Autoencoder
- 基于局部熵度量样本不确定性,引导生成过程。
- 在ADNI和TCGA肺癌数据上分类准确率提升显著。
- 适合处理高维生物医学数据中的类别不平衡问题。
类别不平衡仍是机器学习中的主要挑战,尤其在高维生物医学数据中,非线性流形结构占据主导地位。传统过采样方法如SMOTE依赖局部线性插值,常生成不合理合成样本。深度生成模型如条件变分自编码器(CVAE)能更好捕捉非线性分布,但标准变体对所有少数类样本一视同仁,忽视了边界区域、不确定样本的重要性——这正是边沿SMOTE和ADASYN等启发式方法强调的。本文提出局部熵引导的过采样框架LEO-CVAE,显式将局部不确定性融入表征学习与数据生成。通过计算样本邻域内类别分布的香农熵来量化不确定性:熵越高,表示类别重叠越严重,越不确定。LEO-CVAE利用该信号设计两种机制:(i) 局部熵加权损失(LEWL),强化在不确定区域的鲁棒学习;(ii) 基于熵的采样策略,集中生成于这些信息丰富、类别重叠的区域。在临床基因组数据集(ADNI与TCGA肺癌)上的实验表明,LEO-CVAE持续优于传统过采样与生成基线,验证了不确定性感知生成过采样在具有复杂非线性结构的领域(如组学数据)中的有效性。
原文摘要 · Abstract (English)
Class imbalance remains a major challenge in machine learning, especially for high-dimensional biomedical data where nonlinear manifold structures dominate. Traditional oversampling methods such as SMOTE rely on local linear interpolation, often producing implausible synthetic samples. Deep generative models like Conditional Variational Autoencoders (CVAEs) better capture nonlinear distributions, but standard variants treat all minority samples equally, neglecting the importance of uncertain, boundary-region examples emphasized by heuristic methods like Borderline-SMOTE and ADASYN. We propose Local Entropy-Guided Oversampling with a CVAE (LEO-CVAE), a generative oversampling framework that explicitly incorporates local uncertainty into both representation learning and data generation. To quantify uncertainty, we compute Shannon entropy over the class distribution in a sample's neighborhood: high entropy indicates greater class overlap, serving as a proxy for uncertainty. LEO-CVAE leverages this signal through two mechanisms: (i) a Local Entropy-Weighted Loss (LEWL) that emphasizes robust learning in uncertain regions, and (ii) an entropy-guided sampling strategy that concentrates generation in these informative, class-overlapping areas. Applied to clinical genomics datasets (ADNI and TCGA lung cancer), LEO-CVAE consistently improves classifier performance, outperforming both traditional oversampling and generative baselines. These results highlight the value of uncertainty-aware generative oversampling for imbalanced learning in domains governed by complex nonlinear structures, such as omics data.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。