新方法让高阶张量数据分类更准,保留结构还能优化分类边界。
Structure-Preserving Margin Distribution Learning for High-Order Tensor Data with Low-Rank Decomposition
- 直接在张量上操作,不打平数据,保持多维结构
- 用低秩分解参数化权重,结合均值和方差优化分类边界
- 在图像和脑成像数据上比传统方法更准确,适合高维张量任务
大型边缘分布机器(LMDM)是一种新型分类器设计,不仅优化最小边缘,还优化整个边缘分布,从而提升泛化能力。然而,现有LMDM仅适用于向量化输入,处理高维张量数据时需打平,破坏了数据的多模态结构并增加计算负担。本文提出结构保形边缘分布学习方法(SPMD-LRT),直接在张量表示上操作,不进行向量化。该方法通过引入一阶和二阶张量统计量(边缘均值与方差)来保持多维空间结构,并采用低秩张量分解技术(包括秩-1 CP、高秩CP及Tucker分解)参数化权重张量。设计了交替优化算法(双梯度下降),迭代更新因子矩阵与核心张量。实验在多种数据集(如MNIST、图像、fMRI神经影像)上验证,SPMD-LRT显著优于传统SVM、基于向量的LMDM以及先前张量型支持向量机(如支持张量机、支持Tucker机)。特别地,采用Tucker分解的SPMD-LRT达到最高准确率,证明结构保形的有效性。结果表明该方法在高维张量分类中具有优异性能与鲁棒性。
原文摘要 · Abstract (English)
The Large Margin Distribution Machine (LMDM) is a recent advancement in classifier design that optimizes not just the minimum margin (as in SVM) but the entire margin distribution, thereby improving generalization. However, existing LMDM formulations are limited to vectorized inputs and struggle with high-dimensional tensor data due to the need for flattening, which destroys the data's inherent multi-mode structure and increases computational burden. In this paper, we propose a Structure-Preserving Margin Distribution Learning for High-Order Tensor Data with Low-Rank Decomposition (SPMD-LRT) that operates directly on tensor representations without vectorization. The SPMD-LRT preserves multi-dimensional spatial structure by incorporating first-order and second-order tensor statistics (margin mean and variance) into the objective, and it leverages low-rank tensor decomposition techniques including rank-1(CP), higher-rank CP, and Tucker decomposition to parameterize the weight tensor. An alternating optimization (double-gradient descent) algorithm is developed to efficiently solve the SPMD-LRT, iteratively updating factor matrices and core tensor. This approach enables SPMD-LRT to maintain the structural information of high-order data while optimizing margin distribution for improved classification. Extensive experiments on diverse datasets (including MNIST, images and fMRI neuroimaging) demonstrate that SPMD-LRT achieves superior classification accuracy compared to conventional SVM, vector-based LMDM, and prior tensor-based SVM extensions (Support Tensor Machines and Support Tucker Machines). Notably, SPMD-LRT with Tucker decomposition attains the highest accuracy, highlighting the benefit of structure preservation. These results confirm the effectiveness and robustness of SPMD-LRT in handling high-dimensional tensor data for classification.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。