用硬标签学习模糊数据,提升模型泛化能力
Learning from Ambiguous Data with Hard Labels
- 将模糊数据的硬标签视为软标签的有偏近似,构建新学习框架
- 提出类别级正未标记风险估计器,仅用模糊硬标签训练准确分类器
- 适合标注不清晰的真实数据场景,如医学图像、开放词汇识别
现实数据常包含固有模糊性,而传统单硬标签标注方式忽略此问题。使用此类硬标签标准训练可能使模型过度自信,导致泛化性能下降。本文提出量化标签学习(Quantized Label Learning, QLL)框架:首先将问题建模为从(极)模糊数据中学习硬标签——每个实例的真实标签应为软标签分布,但实际只能观测到从该分布中采样的硬标签,即对真实软标签的有偏近似;其次,提出类别级正未标记(Class-wise Positive-Unlabeled, CPU)风险估计器,可在仅含模糊硬标签的数据上训练出高精度分类器;最后,设计基于混合的模糊数据生成方法以模拟真实世界中的模糊标注数据,用于实验评估。实验表明,所提CPU方法显著提升模型泛化性能,优于现有基线。
原文摘要 · Abstract (English)
Real-world data often contains intrinsic ambiguity that the common single-hard-label annotation paradigm ignores. Standard training using ambiguous data with these hard labels may produce overly confident models and thus leading to poor generalization. In this paper, we propose a novel framework called Quantized Label Learning (QLL) to alleviate this issue. First, we formulate QLL as learning from (very) ambiguous data with hard labels: ideally, each ambiguous instance should be associated with a ground-truth soft-label distribution describing its corresponding probabilistic weight in each class, however, this is usually not accessible; in practice, we can only observe a quantized label, i.e., a hard label sampled (quantized) from the corresponding ground-truth soft-label distribution, of each instance, which can be seen as a biased approximation of the ground-truth soft-label. Second, we propose a Class-wise Positive-Unlabeled (CPU) risk estimator that allows us to train accurate classifiers from only ambiguous data with quantized labels. Third, to simulate ambiguous datasets with quantized labels in the real world, we design a mixing-based ambiguous data generation procedure for empirical evaluation. Experiments demonstrate that our CPU method can significantly improve model generalization performance and outperform the baselines.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。