解决医学影像长尾分布下的开放集半监督学习问题
Open-Set Semi-Supervised Learning for Long-Tailed Medical Datasets
- 在特征层面加正则化,结合分类器归一化缓解长尾偏差
- 在ISIC2018/2019和TissueMNIST上提升闭集与开集准确率
- 适合处理标注少、类别不均衡的医疗图像识别场景
许多实际医学影像场景包含代表性不足但至关重要的类别。模型在真实应用中的有效性取决于其对罕见类和未见类的泛化能力。现实世界数据具有高度不平衡性,导致模型偏向常见类别;同时可能包含需识别的未见类别,且数据稀缺影响性能。现有方法未充分考虑这些复杂性。为此,我们提出一种针对高度不平衡医学数据集的半监督开放集学习方法。通过分析长尾分布对模型本质特性的影响,在特征层面实施正则化,并结合分类器归一化技术。在公开数据集ISIC2018、ISIC2019和TissueMNIST上进行大量实验,使用不同数量的标注样本。结果表明,有效应对长尾数据显著提升了网络在所有数据集上的闭集与开集准确率。代码与训练模型将公开于https://github.com/Daniyanaj/OpenLTR。
原文摘要 · Abstract (English)
Many practical medical imaging scenarios include categories that are under-represented but still crucial. The relevance of image recognition models to real-world applications lies in their ability to generalize to these rare classes as well as unseen classes. Real-world generalization requires taking into account the various complexities that can be encountered in the real-world. First, training data is highly imbalanced, which may lead to model exhibiting bias toward the more frequently represented classes. Moreover, real-world data may contain unseen classes that need to be identified, and model performance is affected by the data scarcity. While medical image recognition has been extensively addressed in the literature, current methods do not take into account all the intricacies in the real-world scenarios. To this end, we propose an open-set learning method for highly imbalanced medical datasets using a semi-supervised approach. Understanding the adverse impact of long-tail distribution at the inherent model characteristics, we implement a regularization strategy at the feature level complemented by a classifier normalization technique. We conduct extensive experiments on the publicly available datasets, ISIC2018, ISIC2019, and TissueMNIST with various numbers of labelled samples. Our analysis shows that addressing the impact of long-tail data in classification significantly improves the overall performance of the network in terms of closed-set and open-set accuracies on all datasets. Our code and trained models will be made publicly available at https://github.com/Daniyanaj/OpenLTR.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。