提升噪声标签分类的鲁棒性,通过后验差异引导模型修正预测。
Selective Posterior Margin Regularization for Forward-Corrected Classification

- 基于反向后验差距设计梯度更新策略,仅强化显著分歧。
- 在五个基准上比标准前向校正提升2.5-7.0个百分点。
- 适用于噪声标签、弱监督及复杂架构,无需额外标注。
带类别条件标签噪声的学习通常依赖从潜在清洁类别到观测标注的转移模型。前向校正将此转移嵌入似然中,但有限样本网络仍可能记忆错误标签。校正后的似然诱导出一个反向后验,用于解释每个标注。当其主导类别与标注不一致时,模型与转移矩阵提供该标注的证据不足,但其他候选类别可能仍高度接近。我们提出选择性后验边缘正则化(SPMR),在保持前向目标的同时,将这种不一致转化为对清洁分类器的分级更新。SPMR选取反向后验主导类别,按两个主导后验类别的分离度缩放脱离的成对边缘,并对模糊冲突赋予较小影响。该差距分解为转移调整的成对分离与主导对的后验质量。活跃边缘沿局部最小范数逻辑方向扩展选定的成对边缘。在五个已知转移基准上,SPMR使完整前向校正提升2.5-7.0个百分点,且在使用Mixup和早停时仍领先前向校正0.7-2.5个百分点。匹配干预支持来自后验空间系数、转移调整目标和成对动作的独立增益。该设计可迁移至估计转移、人工标注、架构变化及更强前向方案。该公式利用前向校正内部已有的潜在类别证据,不将每处后验冲突都视为校正标签。
原文摘要 · Abstract (English)
Learning with class-conditional label noise often relies on a transition model from latent clean classes to observed annotations. Forward correction embeds this transition in the likelihood, yet finite-sample networks may still memorize corrupted labels. The corrected likelihood also induces a reverse posterior over the clean classes that could explain each annotation. When its leading class differs from the annotation, the model and transition matrix provide evidence against that annotation, but the leading alternatives can remain nearly tied. We introduce Selective Posterior Margin Regularization (SPMR), which preserves the Forward objective and converts this disagreement into a graded update on the clean classifier. SPMR selects the leading reverse-posterior class, scales a detached pairwise margin by the separation between the two leading posterior classes, and assigns correspondingly little influence to diffuse conflicts. The gap factorizes into transition- adjusted pairwise separation and the posterior mass carried by the leading pair. The active margin follows the locally minimum-norm logit direction that enlarges the selected pairwise margin. Across five known-transition benchmarks, SPMR improves full-length Forward by 2.5-7.0 percentage points and remains 0.7-2.5 percentage points above Forward with Mixup and early stopping. Matched interventions support distinct gains from the posterior-space coefficient, transition-adjusted target, and pairwise action. The same design transfers to estimated transitions, human annotations, architectural changes, and stronger Forward recipes. The formulation uses latent-class evidence already available inside Forward correction without promoting every posterior conflict to a corrected label.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。