arXiv:2602.06353cs.LG2026-02

提出双机制增强深度森林,提升标签分布学习性能。

Enhance and Reuse: A Dual-Mechanism Approach to Boost Deep Forest for Label Distribution Learning

  • 利用标签相关性增强特征,提升样本信息丰富度。
  • 对表现差的样本重用前层特征,保持训练稳定。
  • 适合需要高效标签关联建模的场景。

标签分布学习(LDL)要求模型预测每个样本与各标签的相关程度。关键挑战在于挖掘标签间的相关性。深度森林(DF)是一种基于树集成的深度学习框架,无需反向传播,通过层内预测进行特征变换,在多个任务上表现优异。然而其在LDL领域的应用仍处于初级阶段,现有方法未能有效利用标签相关性。为此,本文提出增强与重用特征深度森林(ERDF),包含两个核心机制:一是利用标签相关性增强原始特征,使样本获取更全面的信息以支持LDL任务;二是对在验证集上表现劣于前一层的样本,重用其先前层的特征,确保训练过程稳定性。这种‘增强-重用’模式不仅丰富了样本特征,还验证新特征有效性并防止噪声扩散。实验表明,该方法在六个评估指标上优于对比算法。

原文摘要 · Abstract (English)

Label distribution learning (LDL) requires the learner to predict the degree of correlation between each sample and each label. To achieve this, a crucial task during learning is to leverage the correlation among labels. Deep Forest (DF) is a deep learning framework based on tree ensembles, whose training phase does not rely on backpropagation. DF performs in-model feature transform using the prediction of each layer and achieves competitive performance on many tasks. However, its exploration in the field of LDL is still in its infancy. The few existing methods that apply DF to the field of LDL do not have effective ways to utilize the correlation among labels. Therefore, we propose a method named Enhanced and Reused Feature Deep Forest (ERDF). It mainly contains two mechanisms: feature enhancement exploiting label correlation and measure-aware feature reuse. The first one is to utilize the correlation among labels to enhance the original features, enabling the samples to acquire more comprehensive information for the task of LDL. The second one performs a reuse operation on the features of samples that perform worse than the previous layer on the validation set, in order to ensure the stability of the training process. This kind of Enhance-Reuse pattern not only enables samples to enrich their features but also validates the effectiveness of their new features and conducts a reuse process to prevent the noise from spreading further. Experiments show that our method outperforms other comparison algorithms on six evaluation metrics.

深度森林标签分布学习特征增强树集成

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。