提出新方法精准识别多分类中特定类别的影响因子
Multi forests: Variable importance for multi-class outcomes
- 构建多分类随机森林(MuFs),结合多路与二分分裂提升类别区分能力
- 新变量重要性度量可准确识别仅与特定类别相关的变量
- 适合关注类别特异性因素的生物、医学等多分类分析场景
在多分类预测任务中,识别与特定类别相关联的变量至关重要。传统随机森林的变量重要性度量(如置换重要性、基尼重要性)仅关注整体预测性能或节点纯度,无法区分仅区分类别组的变量与真正与特定类别相关的变量。为此,我们提出一种针对多分类的变量重要性度量(multi-class VIM),基于新型随机森林变体——多森林(MuFs)。MuFs 的树结构采用多路和二分分裂相结合的方式:多路分裂为每个类别生成子节点,并使用评估各子节点代表其对应类别程度的分裂准则;该机制构成 multi-class VIM,衡量变量在分裂中对类别区分的能力。同时引入判别性重要性度量(discriminatory VIM),基于二分分裂评估变量的总体影响。模拟研究表明,multi-class VIM 能有效将类别相关变量排在前列,而传统 VIM 则会错误地将非类别特异变量也排高。对 121 个真实数据集的分析显示,MuFs 的预测性能略低于传统 RFs,但此并非主要限制,因算法核心目标是计算 multi-class VIM。
原文摘要 · Abstract (English)
In prediction tasks with multi-class outcomes, identifying covariates specifically associated with one or more outcome classes can be important. Conventional variable importance measures (VIMs) from random forests (RFs), like permutation and Gini importance, focus on overall predictive performance or node purity, without differentiating between the classes. Therefore, they can be expected to fail to distinguish class-associated covariates from covariates that only distinguish between groups of classes. We introduce a VIM called multi-class VIM, tailored for identifying exclusively class-associated covariates, via a novel RF variant called multi forests (MuFs). The trees in MuFs use both multi-way and binary splitting. The multi-way splits generate child nodes for each class, using a split criterion that evaluates how well these nodes represent their respective classes. This setup forms the basis of the multi-class VIM, which measures the discriminatory ability of the splits performed in the respective covariates with regard to this split criterion. Alongside the multi-class VIM, we introduce a second VIM, the discriminatory VIM. This measure, based on the binary splits, assesses the strength of the general influence of the covariates, irrespective of their class-associatedness. Simulation studies demonstrate that the multi-class VIM specifically ranks class-associated covariates highly, unlike conventional VIMs which also rank other types of covariates highly. Analyses of 121 datasets reveal that MuFs often have slightly lower predictive performance compared to conventional RFs. This is, however, not a limiting factor given the algorithm's primary purpose of calculating the multi-class VIM.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。