提出新方法处理复杂非欧数据的降维,对异常值更鲁棒。
Fréchet Cumulative Covariance Net for Deep Nonlinear Sufficient Dimension Reduction with Random Objects
- 基于弗雷歇累积协方差构建非线性降维框架。
- 在欧氏与非欧数据上均表现优异,收敛速度达最小极大率。
- 适合处理图像、形状等复杂结构数据的分析任务。
非线性充分降维可构建高维数据的非线性低维表示以概括关键特征,是表征学习的重要分支。然而,现有方法难以处理响应变量为复杂非欧随机对象的情况,这在近年统计应用中频繁出现。本文引入新的统计依赖度量——弗雷歇累积协方差(FCCov),并基于此构建新型非线性充分降维框架。该方法不仅适用于复杂非欧数据,且对异常值具有鲁棒性。我们进一步结合前馈神经网络(FNN)和卷积神经网络(CNN)在样本层面估计非线性充分方向。理论上,我们证明了带平方Frobenius范数正则化的估计在σ-域上无偏;同时建立了基于FNN与残差型CNN的估计器的非渐近收敛速率,其达到非参数回归的极小极大率,仅差对数因子。大量模拟实验验证了方法在欧氏与非欧设置下的性能。我们将方法应用于面部表情识别数据集,结果凸显其更真实、更广泛的应用潜力。
原文摘要 · Abstract (English)
Nonlinear sufficient dimension reduction\citep{libing_generalSDR}, which constructs nonlinear low-dimensional representations to summarize essential features of high-dimensional data, is an important branch of representation learning. However, most existing methods are not applicable when the response variables are complex non-Euclidean random objects, which are frequently encountered in many recent statistical applications. In this paper, we introduce a new statistical dependence measure termed Fréchet Cumulative Covariance (FCCov) and develop a novel nonlinear SDR framework based on FCCov. Our approach is not only applicable to complex non-Euclidean data, but also exhibits robustness against outliers. We further incorporate Feedforward Neural Networks (FNNs) and Convolutional Neural Networks (CNNs) to estimate nonlinear sufficient directions in the sample level. Theoretically, we prove that our method with squared Frobenius norm regularization achieves unbiasedness at the $σ$-field level. Furthermore, we establish non-asymptotic convergence rates for our estimators based on FNNs and ResNet-type CNNs, which match the minimax rate of nonparametric regression up to logarithmic factors. Intensive simulation studies verify the performance of our methods in both Euclidean and non-Euclidean settings. We apply our method to facial expression recognition datasets and the results underscore more realistic and broader applicability of our proposal.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。