通过划分标签簇并链式传递信息,提升多标签分类准确率。
Label Cluster Chains for Multi-Label Classification
- 将标签空间划分为互斥簇,按簇链式传递标签信息。
- 在多个数据集上优于经典集成链方法ECC,提升预测性能。
- 适合标签间存在相关性的复杂多标签任务场景。
多标签分类是可同时为实例分配多个标签的监督学习任务。现有方法包括将问题拆解为子问题(局部法)、一次性学习所有标签(全局法)以及组合多个分类器(集成法)。无论采用何种方法,探索和学习标签相关性对提升预测效果至关重要。集成分类器链(ECC)是一种知名多标签方法,能有效利用标签相关性,在多个数据集和评估指标上表现良好。然而,其面临标签空间高维带来的挑战,全级联链的复杂度随特征空间扩展而急剧上升。为此,本文提出标签簇链(LCC-ML),先在标签空间应用划分方法得到不相交的关联标签簇,再在训练阶段以各簇真实标签作为后续簇的新特征;测试阶段则使用各簇预测标签作为后续簇的输入特征。每个簇内采用多标签随机森林作为基础分类器,融合输出获得最终多标签分类结果。实验表明,本方法在多个数据集上优于原始ECC,验证了通过分离相关标签簇并链式建模能更有效地挖掘标签相关性。
原文摘要 · Abstract (English)
Multi-label classification is a type of supervised machine learning that can simultaneously assign multiple labels to an instance. To solve this task, some methods divide the original problem into several sub-problems (local approach), others learn all labels at once (global approach), and others combine several classifiers (ensemble approach). Regardless of the approach used, exploring and learning label correlations is important to improve the classifier predictions. Ensemble of Classifier Chains (ECC) is a well-known multi-label method that considers label correlations and can achieve good overall performance on several multi-label datasets and evaluation measures. However, one of the challenges when working with ECC is the high dimensionality of the label space, which can impose limitations for fully-cascaded chains as the complexity increases regarding feature space expansion. To improve classifier chains, we propose a method to chain disjoint correlated label clusters obtained by applying a partition method in the label space. During the training phase, the ground truth labels of each cluster are used as new features for all of the following clusters. During the test phase, the predicted labels of clusters are used as new features for all the following clusters. Our proposal, called Label Cluster Chains for Multi-Label Classification (LCC-ML), uses multi-label Random Forests as base classifiers in each cluster, combining their predictions to obtain a final multi-label classification. Our proposal obtained better results compared to the original ECC. This shows that learning and chaining disjoint correlated label clusters can better explore and learn label correlations.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。