arXiv:2512.12122cs.LG2025-12被引 1

提出新型张量判别分析法,提升高维小样本分类性能

High-Dimensional Tensor Discriminant Analysis: Low-Rank Discriminant Structure, Representation Synergy, and Theoretical Guarantees

  • 引入CP低秩结构建模判别张量,捕捉多线性成分中的关键信号
  • 在弱信号条件下实现全局收敛与最优误分类率
  • 适用于神经网络特征等非正态张量数据,适合高维小样本场景

高维张量预测器在现代应用中日益常见,常为神经网络的生成表示。现有张量分类方法依赖稀疏性或Tucker结构,且缺乏理论保障。基于判别信号集中于少数多线性分量的实证发现,本文首次引入判别张量的CP低秩结构。在张量高斯混合模型下,提出高维CP低秩张量判别分析(CP-TDA),采用随机复合主成分分析(rc-PCA)初始化,有效处理依赖性和各向异性噪声,在更弱的信号强度与非相干条件下仍具稳定性,并通过迭代优化算法实现。理论证明全局收敛及最小最大最优误分类率。针对偏离张量正态性的数据,构建首个半参数张量判别模型,利用深度生成模型将学习到的张量表示映射至适配CP-TDA的潜空间。误分类风险分解为表示、近似与估计误差。数值实验与图分类真实数据分析表明,在高维小样本情形下显著优于现有张量分类器和前沿图神经网络。

原文摘要 · Abstract (English)

High-dimensional tensor-valued predictors arise in modern applications, increasingly as learned representations from neural networks. Existing tensor classification methods rely on sparsity or Tucker structures and often lack theoretical guarantees. Motivated by empirical evidence that discriminative signals concentrate along a few multilinear components, we introduce CP low-rank structure for the discriminant tensor, a modeling perspective not previously explored. Under a Tensor Gaussian Mixture Model, we propose high-dimensional CP low-rank Tensor Discriminant Analysis (CP-TDA) with Randomized Composite PCA (\textsc{rc-PCA}) initialization, that is essential for handling dependent and anisotropic noise under weaker signal strength and incoherence conditions, followed by iterative refinement algorithm. We establish global convergence and minimax-optimal misclassification rates. To handle tensor data deviating from tensor normality, we develop the first semiparametric tensor discriminant model, in which learned tensor representations are mapped via deep generative models into a latent space tailored for CP-TDA. Misclassification risk decomposes into representation, approximation, and estimation errors. Numerical studies and real data analysis on graph classification demonstrate substantial gains over existing tensor classifiers and state-of-the-art graph neural networks, particularly in high-dimensional, small-sample regimes.

张量分析判别分析高维数据机器学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。