提出一种融合稀疏性与类间区分性的线性特征提取方法,提升分类性能。
A supervised discriminant data representation: application to pattern classification
- 结合RSLDA与ICS_DLSR优点,通过稀疏性筛选关键特征并保持同类样本一致性。
- 在人脸、物体和数字数据集上,多数情况下优于现有竞争方法。
- 适用于需要高区分性特征表示的监督多分类任务。
机器学习与模式识别算法的性能通常依赖于数据表示。因此,当前许多研究致力于设计预处理框架和数据变换以支持有效的机器学习。本文提出一种混合线性特征提取方案,用于监督多分类问题。受最近两种线性判别方法——鲁棒稀疏线性判别分析(RSLDA)和基于类间稀疏性的判别最小二乘回归(ICS_DLSR)的启发,我们提出一个统一准则,能够保留这两种方法的优势。所提变换利用稀疏性促进技术,既选择最能代表数据的特征,又保持同类别样本的行稀疏性一致性。线性变换与正交矩阵通过基于梯度下降的交替迭代优化方案估计,并采用不同初始化策略。该框架具有通用性,可组合与调优其他线性判别嵌入方法。在多个数据集(包括人脸、物体和数字)上的实验表明,所提方法在大多数情况下优于现有方法。
原文摘要 · Abstract (English)
The performance of machine learning and pattern recognition algorithms generally depends on data representation. That is why, much of the current effort in performing machine learning algorithms goes into the design of preprocessing frameworks and data transformations able to support effective machine learning. The method proposed in this work consists of a hybrid linear feature extraction scheme to be used in supervised multi-class classification problems. Inspired by two recent linear discriminant methods: robust sparse linear discriminant analysis (RSLDA) and inter-class sparsitybased discriminative least square regression (ICS_DLSR), we propose a unifying criterion that is able to retain the advantages of these two powerful methods. The resulting transformation relies on sparsity-promoting techniques both to select the features that most accurately represent the data and to preserve the row-sparsity consistency property of samples from the same class. The linear transformation and the orthogonal matrix are estimated using an iterative alternating minimization scheme based on steepest descent gradient method and different initialization schemes. The proposed framework is generic in the sense that it allows the combination and tuning of other linear discriminant embedding methods. According to the experiments conducted on several datasets including faces, objects, and digits, the proposed method was able to outperform competing methods in most cases.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。