比较两种数据整合方法,揭示最优加权下栈式SVD更优。
Stacked SVD or SVD stacked? A Random Matrix Theory perspective on data integration
- 从随机矩阵理论出发分析两类数据整合方法的性能极限。
- 理论证明加权后栈式SVD优于SVD堆叠,且可实现相变边界精确预测。
- 提供实际可操作的权重估计算法,适用于基因组等高维数据场景。
现代数据分析需在多个高维数据集中识别共享的潜在结构。常见模型假设数据矩阵是低秩矩阵的噪声观测,具有共享的奇异子空间。目前有两种主要方法:一是将所有数据拼接后做SVD(Stack-SVD);二是对每份数据独立做SVD,再聚合顶部奇异向量并求共识(SVD-Stack)。尽管广泛应用,二者在比例渐近条件下缺乏严格理论分析,导致方法选择困惑,限制了其潜力发挥。本文从随机矩阵理论出发,推导出两方法的渐近性能与相变边界,并提出最优加权方案以提升性能。结果表明,在未加权情况下两者无绝对优劣,但经最优加权后,Stack-SVD全面优于SVD-Stack。我们还将分析扩展至多共享成分情形,提出基于数据的最优权重估计算法,为实际数据整合问题提供理论指导。大量数值模拟与基因组半合成实验验证了理论结论。
原文摘要 · Abstract (English)
Modern data analysis increasingly requires identifying shared latent structure across multiple high-dimensional datasets. A commonly used model assumes that the data matrices are noisy observations of low-rank matrices with a shared singular subspace. In this case, two primary methods have emerged for estimating this shared structure, which vary in how they integrate information across datasets. The first approach, termed Stack-SVD, concatenates all the datasets, and then performs a singular value decomposition (SVD). The second approach, termed SVD-Stack, first performs an SVD separately for each dataset, then aggregates the top singular vectors across these datasets, and finally computes a consensus amongst them. While these methods are widely used, they have not been rigorously studied in the proportional asymptotic regime, which is of great practical relevance in today's world of increasing data size and dimensionality. This lack of theoretical understanding has led to uncertainty about which method to choose and limited the ability to fully exploit their potential. To address these challenges, we derive exact expressions for the asymptotic performance and phase transitions of these two methods and develop optimal weighting schemes to further improve both methods. Our analysis reveals that while neither method uniformly dominates the other in the unweighted case, optimally weighted Stack-SVD dominates optimally weighted SVD-Stack. We extend our analysis to accommodate multiple shared components, and provide practical algorithms for estimating optimal weights from data, offering theoretical guidance for method selection in practical data integration problems. Extensive numerical simulations and semi-synthetic experiments on genomic data corroborate our theoretical findings.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。