arXiv:2505.20563cs.LGcs.CV2025-05

提出双层次无监督特征选择方法,同时优化数据结构与特征重要性。

Bi-Level Unsupervised Feature Selection

  • 分聚类层和特征层双重框架,分别处理数据结构与特征筛选
  • 引入ℓ₂,₀范数约束投影矩阵,实现更有效的特征选择
  • 在多个真实数据集上表现优于现有方法,适合高维数据降维

无监督特征选择(UFS)在数据工程中至关重要。然而,多数现有方法仅从单一视角构建模型,难以同时评估特征重要性并保持数据内在结构,从而限制性能。为此,本文提出一种新型双层次无监督特征选择(BLUFS)方法,包含聚类层和特征层。聚类层采用谱聚类生成伪标签以表征数据结构,并构建连续线性回归模型学习投影矩阵;特征层对投影矩阵施加ℓ₂,₀范数约束,更高效地进行特征选择。据我们所知,这是首个将双层次框架与ℓ₂,₀范数结合的工作。为求解该模型,设计了高效的近端交替最小化(PAM)算法,其子问题或具显式解,或可用快速求解器计算。此外,建立了收敛性结果与计算复杂度分析。在两个合成数据集及八个真实数据集上的大量实验表明,BLUFS在聚类与分类任务中均表现出色。

原文摘要 · Abstract (English)

Unsupervised feature selection (UFS) is an important task in data engineering. However, most UFS methods construct models from a single perspective and often fail to simultaneously evaluate feature importance and preserve their inherent data structure, thus limiting their performance. To address this challenge, we propose a novel bi-level unsupervised feature selection (BLUFS) method, including a clustering level and a feature level. Specifically, at the clustering level, spectral clustering is used to generate pseudo-labels for representing the data structure, while a continuous linear regression model is developed to learn the projection matrix. At the feature level, the $\ell_{2,0}$-norm constraint is imposed on the projection matrix for more effectively selecting features. To the best of our knowledge, this is the first work to combine a bi-level framework with the $\ell_{2,0}$-norm. To solve the proposed bi-level model, we design an efficient proximal alternating minimization (PAM) algorithm, whose subproblems either have explicit solutions or can be computed by fast solvers. Furthermore, we establish the convergence result and computational complexity. Finally, extensive experiments on two synthetic datasets and eight real datasets demonstrate the superiority of BLUFS in clustering and classification tasks.

特征选择无监督学习聚类ℓ₂,₀范数

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。