arXiv:2411.01204cs.LGcs.AI2024-11被引 1

按类别区分特征重要性,提升分类可解释性。

Class-specific feature selection for classification explainability

  • 基于类别特异性设计特征选择方法,识别每类独有的关键特征。
  • 提出新型类特定相关矩阵,支持更精细的多分类策略。
  • 适合需要高可解释性的医疗诊断等场景研究者参考。

特征选择旨在找出能同等或更好解释数据行为的特征子集。传统方法通常基于特征排名或子集选择,并以分类或回归任务性能衡量效果,但这些方法忽略了不同类别间特征重要性的差异。本文首次系统梳理了类别特异性概念,强调特征的重要性在各类别中可能显著不同。例如,在肿瘤预测中,每种肿瘤类型对应不同的关键特征组合,具备强区分能力。该视角突破传统全局评估方式,更精准反映各类别独特性。文中还介绍了基于一对一(one-versus-all)和一对多(one-versus-each)的分类框架,并提出一种新颖的深层一对多策略,兼顾可解释性与模型可分解性。进一步提出类特定相关矩阵,可衍生出三层类别特异性分类方案,为高维多分类任务提供新思路。

原文摘要 · Abstract (English)

Feature Selection techniques aim at finding a relevant subset of features that perform equally or better than the original set of features at explaining the behavior of data. Typically, features are extracted from feature ranking or subset selection techniques, and the performance is measured by classification or regression tasks. However, while selected features may not have equal importance for the task, they do have equal importance for each class. This work first introduces a comprehensive review of the concept of class-specific, with a focus on feature selection and classification. The fundamental idea of the class-specific concept resides in the understanding that the significance of each feature can vary from one class to another. This contrasts with the traditional class-independent approach, which evaluates the importance of attributes collectively for all classes. For example, in tumor prediction scenarios, each type of tumor may be associated with a distinct subset of relevant features. These features possess significant discriminatory power, enabling the differentiation of one tumor type from others. This class-specific perspective offers a more effective approach to classification tasks by recognizing and leveraging the unique characteristics of each class. Secondly, classification schemes from one-versus-all and one-versus-each strategies are described, and a novel deep one-versus-each strategy is introduced, which offers advantages from the point of view of explainability (feature selection) and decomposability (classification). Thirdly, a novel class-specific relevance matrix is presented, from which some more sophisticated classification schemes can be derived, such as the three-layer class-specific scheme. The potential for further advancements is wide and will open new horizons for exploring novel research directions in multiclass hyperdimensional contexts.

特征选择可解释性多分类类别特异性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。