提出新方法对高维响应的潜在右因子进行精准推断。
SOFARI-R: High-Dimensional Manifold-Based Inference for Latent Responses
- 基于流形构造新推断框架,解决右因子估计难题
- 两种变体均实现渐近正态性与偏差校正
- 适用于多任务学习中需量化不确定性的场景
在存在大量响应与特征的多任务学习中,数据降维与不确定性量化至关重要。现有基于高维流形的SOFAR推断框架(SOFARI)主要关注左因子向量和奇异值,但对右因子向量的推断因响应矩阵左右奇异向量的非对称性而面临挑战。本文提出SOFARI-R方法,引入两种变体:第一种针对强正交因子,将左奇异向量与设计矩阵结合并重新缩放,构建新的Stiefel流形;第二种处理更一般的弱正交因子,采用硬阈值SOFARI估计,并将近似误差巧妙纳入分布建模。两种方法均得到右因子向量的偏差校正估计,其分布渐近正态且方差估计合理。通过大量模拟研究与经济应用验证了方法的有效性。
原文摘要 · Abstract (English)
Data reduction with uncertainty quantification plays a key role in various multi-task learning applications, where large numbers of responses and features are present. To this end, a general framework of high-dimensional manifold-based SOFAR inference (SOFARI) was introduced recently in Zheng, Zhou, Fan and Lv (2024) for interpretable multi-task learning inference focusing on the left factor vectors and singular values exploiting the latent singular value decomposition (SVD) structure. Yet, designing a valid inference procedure on the latent right factor vectors is not straightforward from that of the left ones and can be even more challenging due to asymmetry of left and right singular vectors in the response matrix. To tackle these issues, in this paper we suggest a new method of high-dimensional manifold-based SOFAR inference for latent responses (SOFARI-R), where two variants of SOFARI-R are introduced. The first variant deals with strongly orthogonal factors by coupling left singular vectors with the design matrix and then appropriately rescaling them to generate new Stiefel manifolds. The second variant handles the more general weakly orthogonal factors by employing the hard-thresholded SOFARI estimates and delicately incorporating approximation errors into the distribution. Both variants produce bias-corrected estimators for the latent right factor vectors that enjoy asymptotically normal distributions with justified asymptotic variance estimates. We demonstrate the effectiveness of the newly suggested method using extensive simulation studies and an economic application.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。