arXiv:2411.06100cs.LGstat.ML2024-11

用新型内积方法构建特征坐标,提升图像分类精度

Mutual-energy inner product optimization method for constructing feature coordinates and image classification in Machine Learning

  • 基于非均匀膜的微分方程定义互能内积,优化特征表示
  • 相比欧氏内积显著增强低频特征、抑制高频噪声
  • 在手写数字数据集上实现高精度分类,适合特征提取任务

作为机器学习中的关键任务,数据分类本质上是寻找合适的坐标系来表示不同类别样本的特征。本文提出一种互能内积优化方法以构建特征坐标系。首先,通过分析描述非均匀膜的偏微分方程的解空间与本征函数,定义了互能内积;其次,将互能内积表示为本征函数级数,显示其相比欧氏内积在增强低频特征、抑制高频噪声方面具有显著优势。随后,构建了互能内积优化模型,并讨论了目标函数的凸性与凹性。接着,结合有限元法,设计了一种稳定高效的逐次线性化算法,该算法仅需求解正定对称矩阵方程和少量约束的线性规划问题,且给出了向量化实现方案。最后,利用该方法构建特征坐标,在MINST训练集上提取特征,并训练多类高斯分类器,结果在MINST测试集上取得良好预测性能。

原文摘要 · Abstract (English)

As a key task in machine learning, data classification is essentially to find a suitable coordinate system to represent data features of different classes of samples. This paper proposes the mutual-energy inner product optimization method for constructing a feature coordinate system. First, by analyzing the solution space and eigenfunctions of partial differential equations describing a non-uniform membrane, the mutual-energy inner product is defined. Second, by expressing the mutual-energy inner product as a series of eigenfunctions, it shows a significant advantage of enhancing low-frequency features and suppressing high-frequency noise, compared with the Euclidean inner product. And then, a mutual-energy inner product optimization model is built to extract data features, and convexity and concavity properties of its objective function are discussed. Next, by combining the finite element method, a stable and efficient sequential linearization algorithm is constructed to solve the optimization model. This algorithm only solves equations including positive definite symmetric matrix and linear programming with a few constraints, and its vectorized implementation is discussed. Finally, the mutual-energy inner product optimization method is used to construct feature coordinates, and multi-class Gaussian classifiers are trained on the MINST training set. Good prediction results of Gaussian classifiers are achieved on the MINST test set.

特征提取内积优化图像分类有限元法

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。