arXiv:2607.16638math.STcs.LG2026-07

修正主成分回归中特征值膨胀问题,提升高维预测精度

De-floored Principal Component Regression: When Rank Selection Alone Is Insufficient for Prediction

  • 提出dPCR方法,通过减去估计的样本空间底面修正特征值
  • 在特定条件下,dPCR预测风险远低于最优普通PCR方法
  • 适用于高维数据建模,尤其适合特征值分布不均场景

主成分回归(PCR)通过选择谱截断来正则化高维预测,但秩选择无法纠正保留的样本特征值的系统性膨胀。本文研究干净的高斯随机设计,其中总体协方差尾部产生一个接近预测头部尺度的近似标量样本空间底面。去底主成分回归(dPCR)保留截断并从保留分母中减去估计的底面。我们证明了普通PCR预测风险的统一下界,并给出了dPCR的高概率上界。当底面尖锐且在总体预测风险中移除成本低廉时,dPCR的条件风险相对于最优普通PCR秩可忽略不计。精确的风险分解揭示:分母膨胀由首项谱质量决定,而校正的纯净预测代价由平方谱质量决定。同一样本的修剪均值底面估计在预设秩下达到理想dPCR上界速率,且当尾部预测能量占比趋于零时,近似预测对齐下该分离仍成立。独立的点态固定维度公式表明,风险最优的正标量校正可改进秩-1 PCR,而均值底面减法通常不适用于广泛的Marcenko-Pastur主体。

原文摘要 · Abstract (English)

Principal component regression (PCR) regularizes high-dimensional prediction by choosing a spectral cutoff, but rank selection cannot correct systematic inflation of the retained empirical eigenvalues. We study clean Gaussian random designs in which the aggregate covariance tail creates a nearly scalar sample-space floor comparable to the predictive head scale. De-floored principal component regression (dPCR) retains the cutoff and subtracts an estimated floor from the retained denominators. We prove an ordinary-PCR prediction-risk lower bound uniform over all ranks and a high-probability dPCR upper bound. When the floor is sharp and inexpensive to remove in population prediction risk, the conditional risk of dPCR is asymptotically negligible relative to that of the best ordinary PCR rank. An exact risk decomposition explains the separation: denominator inflation is governed by first spectral mass, whereas the clean prediction cost of correction is governed by squared spectral mass. A same-sample trimmed-mean floor estimate attains the oracle dPCR upper-bound rate at a prespecified rank, and the separation persists under approximate predictive alignment when the tail prediction-energy fraction vanishes. Separate pointwise fixed-aspect formulas show that the risk-optimal positive scalar correction improves rank-$1$ PCR, whereas mean-floor subtraction is generally not optimal for a broad Marchenko--Pastur bulk.

主成分回归高维统计预测风险特征值修正

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。