通过迁移学习提升小样本下的精度矩阵估计效果
Trans-Glasso: A Transfer Learning Approach to Precision Matrix Estimation
- 分两步:先用多任务学习捕捉跨研究共性与特性,再通过差异网络调整结构差异
- 在小样本下优于基线方法,理论证明达到极小极大最优性能
- 适合生物网络分析,如脑组织基因网络和癌症蛋白网络建模
精度矩阵估计在多个领域至关重要,但目标研究样本有限时极具挑战。迁移学习可通过利用相关源研究数据提升估计准确性。本文提出Trans-Glasso,一种两步迁移学习方法:首先使用多任务学习目标获取初始估计器,以捕捉研究间的共享与独特特征;随后通过差异网络估计对这些估计器进行精修,以校正目标与源精度矩阵间的结构差异。在假设目标精度矩阵的大多数元素与源矩阵共享的前提下,我们推导出非渐近误差界,并证明Trans-Glasso在特定条件下达到极小极大最优。大量模拟实验表明,其在小样本场景下显著优于基线方法。进一步在脑组织基因网络及多种癌症亚型蛋白网络的应用中验证了其有效性。此外,首次给出了差异网络估计的极小极大最优率。Trans-Glasso的Python实现及全部实验复现代码已公开于https://github.com/boxinz17/transglasso-experiments。
原文摘要 · Abstract (English)
Precision matrix estimation is essential in various fields; yet it is challenging when samples for the target study are limited. Transfer learning can enhance estimation accuracy by leveraging data from related source studies. We propose Trans-Glasso, a two-step transfer learning method for precision matrix estimation. First, we obtain initial estimators using a multi-task learning objective that captures shared and unique features across studies. Then, we refine these estimators through differential network estimation to adjust for structural differences between the target and source precision matrices. Under the assumption that most entries of the target precision matrix are shared with source matrices, we derive non-asymptotic error bounds and show that Trans-Glasso achieves minimax optimality under certain conditions. Extensive simulations demonstrate Trans Glasso's superior performance compared to baseline methods, particularly in small-sample settings. We further validate Trans-Glasso in applications to gene networks across brain tissues and protein networks for various cancer subtypes, showcasing its effectiveness in biological contexts. Additionally, we derive the minimax optimal rate for differential network estimation, representing the first such guarantee in this area. The Python implementation of Trans-Glasso, along with code to reproduce all experiments in this paper, is publicly available at https://github.com/boxinz17/transglasso-experiments.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。