提出真正无监督的特征选择评估方法,避免隐含标签信息
Towards Truly Unsupervised Evaluation of Feature Selection

- 用无监督PCA与最优传输构建全新评估框架
- 实验证明传统方法本质仍依赖标签信息
- 适合无标签数据场景的特征选择算法评测
特征选择是数据挖掘中最重要的基础任务之一,已有大量评估方法用于衡量特定方法的质量。然而,目前广泛使用的无监督评估技术存在关键设计缺陷,质疑其真正的无监督性质。本文对这些看似无监督的评估方法进行批判性分析,揭示它们实际上是在无监督下游任务下进行的有监督评估。为此,我们提出一种全新的、真正的无监督评估框架,无需任何标签信息即可衡量特征选择算法的质量。该框架利用无监督主成分分析(Principal Component Analysis)和最优传输(optimal transport)技术,在完全无监督条件下实现评估。
原文摘要 · Abstract (English)
Feature selection is one of the most important and fundamental tasks in data mining, tackled by a family of methods with an established set of evaluation techniques to measure the quality of a specific method. Most of the methods commonly used for the unsupervised evaluation of feature selection algorithms suffer from critical design flaws which question their unsupervised nature. In this paper, we provide a critical discussion on the established allegedly unsupervised evaluation techniques, and shed light on the reasons why they are not truly unsupervised but, at best, supervised evaluation under an unsupervised downstream task. We also propose a novel, truly unsupervised evaluation framework to measure the quality of the feature selection algorithms without any form of information about the labels. The proposed framework utilizes unsupervised Principal Component Analysis, and optimal transport to measure the quality of the feature selection methods in a truly unsupervised manner.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。