解决实时多标签数据流中的噪声与标签分布漂移问题。
Online Multi-Label Classification under Noisy and Changing Label Distribution
- 构建局部特征图联合重构标签分数,提升鲁棒性。
- 通过无偏标签基数差检测分布变化并重置模型参数。
- 闭式解推导实现高效准确的在线更新,适合动态场景。
真实世界中的多标签数据流通常包含噪声标签,涵盖相关与无关标签。现有在线多标签分类方法在标签质量方面受限,难以应对噪声标签。同时,真实标签分布随时间变化,隐藏于观测到的噪声标签分布中,难以追踪,给概念漂移适应带来挑战。为此,我们提出一种在噪声与变化标签分布下的在线多标签分类算法(NCLD)。设计凸目标函数,同时建模标签评分与排序以提高精度,其对噪声和变化标签分布的鲁棒性来自三项创新:1)利用局部特征图联合重构标签分数,并推导无偏排序损失,学习可靠排序信息;2)通过相邻数据块间无偏标签基数差异检测真实标签分布变化,触发模型重置以匹配新分布;3)基于闭式最优解推导出高效的更新规则,实现快速准确的在线更新。实证实验验证了该方法在噪声与变化标签分布下分类的有效性。
原文摘要 · Abstract (English)
Multi-label data stream usually contains noisy labels in the real-world applications, namely occuring in both relevant and irrelevant labels. However, existing online multi-label classification methods are mostly limited in terms of label quality and fail to deal with the case of noisy labels. On the other hand, the ground-truth label distribution may vary with the time changing, which is hidden in the observed noisy label distribution and difficult to track, posing a major challenge for concept drift adaptation. Motivated by this, we propose an online multi-label classification algorithm under Noisy and Changing Label Distribution (NCLD). The convex objective is designed to simultaneously model the label scoring and the label ranking for high accuracy, whose robustness to NCLD benefits from three novel works: 1) The local feature graph is used to reconstruct the label scores jointly with the observed labels, and an unbiased ranking loss is derived and applied to learn reliable ranking information. 2) By detecting the difference between two adjacent chunks with the unbiased label cardinality, we identify the change in the ground-truth label distribution and reset the ranking or all information learned from the past to match the new distribution. 3) Efficient and accurate updating is achieved based on the updating rule derived from the closed-form optimal model solution. Finally, empirical experimental results validate the effectiveness of our method in classifying instances under NCLD.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。