多模态数据下,用重尾分布缓解类别不平衡的半监督学习新方法。
Multimodal Deep Generative Model for Semi-Supervised Learning under Class Imbalance
- 分模态编码+共享潜在变量,用专家乘积法简化联合后验计算。
- 用Student's t分布替代高斯分布,更好建模不平衡数据的长尾特征。
- 在真实和基准数据集上显著提升少数类分类性能,适合多模态场景。
在类别不平衡数据上建模时,必须解决不平衡问题,因为基于此类数据训练的模型往往偏向多数类。该问题在部分监督下被放大,因伪标签由不平衡标注数据预测,导致偏差传播。尽管近期半监督模型已处理类别不平衡,但通常假设输入为单模态数据。随着多模态数据日益普及,利用互补模态至关重要。本文提出一种面向类别不平衡的多模态半监督生成模型。该方法为每种模态使用独立编码器,跨模态共享潜在变量,并采用专家乘积法简化联合后验计算。为进一步缓解类别不平衡,将先验、编码器和解码器中的典型高斯分布替换为Student's t分布,以更好捕捉不平衡数据中重尾的潜在分布。我们推导了基于γ-幂散度的新目标函数,用于在标注和未标注数据上训练该模型。在基准与真实世界数据集上的实验表明,该模型在泛化能力上优于基线方法,在部分标注且类别分布不平衡的多模态数据上取得了更优的分类表现。
原文摘要 · Abstract (English)
When modeling class-imbalanced data, it is crucial to address the imbalance, as models trained on such data tend to be biased towards the majority classes. This problem is amplified under partial supervision, where pseudo-labels for unlabeled data are predicted based on imbalanced labeled data, propagating the bias. While recent semi-supervised models address class imbalance, they typically assume single-modal input data. However, with the growing availability of multimodal data, it is essential to leverage complementary modalities. In this article, we propose a multimodal deep generative model for semi-supervised learning under class imbalance. Our approach uses separate encoders for each modality, sharing latent variables across modalities, and simplifies joint posterior computation with a product-of-experts method. To further address class imbalance, we replace typical Gaussian distributions with Student's t-distributions for the prior, encoder, and decoder, better capturing the heavy-tailed latent distributions in imbalanced data. We derive a new objective function for training the proposed model on both labeled and unlabeled data using $γ$-power divergence. Empirical results on benchmark and real-world datasets demonstrate that our model outperforms baseline methods in generalization, achieving superior classification performance for partially labeled multimodal data with imbalanced class distributions.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。