arXiv:2412.16819math.OCcs.LG2024-12被引 20

提出双稀疏无监督特征选择方法,更好区分相关特征与噪声。

Bi-Sparse Unsupervised Feature Selection

  • 引入ℓ₂,ₚ和ℓᵪ范数联合约束,实现特征选择与去噪统一优化
  • 在多个真实数据集上显著提升特征选择准确率,优于传统PCA方法
  • 适合处理高维无标签数据,尤其适用于图像处理等场景

针对高维无标签数据集的特征选择问题,现有基于主成分分析(PCA)的方法通常仅通过单一稀疏正则化或约束作用于变换矩阵,难以充分挖掘数据结构。本文提出一种新型双稀疏无监督特征选择方法(BSUFS),将ℓ₂,ₚ-范数与ℓᵪ-范数引入经典PCA框架,使方法能同时筛选相关特征并去除无关噪声,从而获得更具判别性的特征表示。其中参数p、q取值范围为[0,1)。该方法构建了统一的双稀疏优化框架,可涵盖部分已有工作作为特例。为求解非凸模型,设计了一种基于Stiefel流形优化与稀疏优化技术的高效近端交替最小化(PAM)算法,并给出计算复杂度分析。在合成与真实数据集上的大量实验验证了方法的有效性,结果表明双稀疏优化在特征选择中具有显著优势,且在图像处理等领域具广泛应用潜力。代码已开源:https://github.com/xianchaoxiu/BSUFS。

原文摘要 · Abstract (English)

To deal with high-dimensional unlabeled datasets in many areas, principal component analysis (PCA) has become a rising technique for unsupervised feature selection (UFS). However, most existing PCA-based methods only consider the structure of datasets by embedding a single sparse regularization or constraint on the transformation matrix. In this paper, we introduce a novel bi-sparse method called BSUFS to improve the performance of UFS. The core idea of BSUFS is to incorporate $\ell_{2,p}$-norm and $\ell_q$-norm into the classical PCA, which enables our method to select relevant features and filter out irrelevant noises, thereby obtaining discriminative features. Here, the parameters $p$ and $q$ are within the range of $[0, 1)$. Therefore, BSUFS not only constructs a unified framework for bi-sparse optimization, but also includes some existing works as special cases. To solve the resulting non-convex model, we propose an efficient proximal alternating minimization (PAM) algorithm using Stiefel manifold optimization and sparse optimization techniques. In addition, the computational complexity analysis is presented. Extensive numerical experiments on synthetic and real-world datasets demonstrate the effectiveness of our proposed BSUFS. The results reveal the advantages of bi-sparse optimization in feature selection and show its potential for other fields in image processing. Our code is available at https://github.com/xianchaoxiu/BSUFS.

特征选择无监督学习稀疏优化主成分分析

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。