arXiv:2410.20388cs.LG2024-10被引 3

提出双流流形重排序算法,提升无监督特征选择效果

Unsupervised Feature Selection Algorithm Based on Dual Manifold Re-ranking

  • 构建样本、特征间多重流形相似矩阵,捕捉数据内在结构
  • 通过样本与特征权重双向迭代优化,显著提升特征选择性能
  • 适合高维数据降维,尤其在缺乏标签时表现更优

高维数据广泛存在于各类数据分析任务中。特征选择旨在从原始高维数据中识别最具代表性的特征。由于缺乏类别标签信息,无监督场景下的特征选择比有监督场景更具挑战性。传统无监督特征选择方法通常基于特定准则对样本特征进行评分,但忽略了样本间的差异性,且未能充分揭示数据内部结构。不同样本的重要性应有所不同,样本与特征之间存在相互影响的双重关系。为此,本文提出一种基于双流形重排序(DMRR)的无监督特征选择算法。通过构建反映样本间、样本-特征间及特征间流形结构的多个相似性矩阵,并结合初始得分进行流形重排序。实验表明,与三种原始无监督特征选择算法及两种后处理算法相比,引入样本重要性信息及样本-特征双重关系有助于实现更优的特征选择结果。

原文摘要 · Abstract (English)

High-dimensional data is commonly encountered in numerous data analysis tasks. Feature selection techniques aim to identify the most representative features from the original high-dimensional data. Due to the absence of class label information, it is significantly more challenging to select appropriate features in unsupervised learning scenarios compared to supervised ones. Traditional unsupervised feature selection methods typically score the features of samples based on certain criteria, treating samples indiscriminately. However, these approaches fail to fully capture the internal structure of the data. The importance of different samples should vary, and there is a dual relationship between the weight of samples and features that will influence each other. Therefore, an unsupervised feature selection algorithm based on dual manifold re-ranking (DMRR) is proposed in this paper. Different similarity matrices are constructed to depict the manifold structures among samples, between samples and features, and among features themselves. Then, manifold re-ranking is performed by combining the initial scores of samples and features. By comparing DMRR with three original unsupervised feature selection algorithms and two unsupervised feature selection post-processing algorithms, experimental results confirm that the importance information of different samples and the dual relationship between sample and feature are beneficial for achieving better feature selection.

特征选择无监督学习流形学习高维数据

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。