提出新方法提升标签分布偏移下的分类性能
Theory-inspired Label Shift Adaptation via Aligned Distribution Mixture
- 设计对齐分布混合框架,融合源与目标分布信息
- 理论证明新方法更优,实测在新冠诊断中表现更好
- 适合处理数据分布变化的场景,如医疗诊断
标签分布偏移是动态环境中一个关键挑战,即训练集和测试集的标签分布不一致。现有方法仅用无标签目标样本估计分布,未参与分类器训练,信息利用不足。直接混合源与目标分布虽常见,但存在理论偏差。本文提出对齐分布混合(ADM)框架,基于泛化理论证明其最优性及误差界。通过改进四类典型方法的训练过程,并引入创新的耦合权重估计策略,设计了一步式算法。针对该策略,进一步开发高效双层优化方法。实验表明,所提方法在多个场景下均有效,尤其在新冠诊断应用中表现突出。
原文摘要 · Abstract (English)
As a prominent challenge in addressing real-world issues within a dynamic environment, label shift, which refers to the learning setting where the source (training) and target (testing) label distributions do not match, has recently received increasing attention. Existing label shift methods solely use unlabeled target samples to estimate the target label distribution, and do not involve them during the classifier training, resulting in suboptimal utilization of available information. One common solution is to directly blend the source and target distributions during the training of the target classifier. However, we illustrate the theoretical deviation and limitations of the direct distribution mixture in the label shift setting. To tackle this crucial yet unexplored issue, we introduce the concept of aligned distribution mixture, showcasing its theoretical optimality and generalization error bounds. By incorporating insights from generalization theory, we propose an innovative label shift framework named as Aligned Distribution Mixture (ADM). Within this framework, we enhance four typical label shift methods by introducing modifications to the classifier training process. Furthermore, we also propose a one-step approach that incorporates a pioneering coupling weight estimation strategy. Considering the distinctiveness of the proposed one-step approach, we develop an efficient bi-level optimization strategy. Experimental results demonstrate the effectiveness of our approaches, together with their effectiveness in COVID-19 diagnosis applications.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。