arXiv:2506.19598cs.LGq-bio.PE2025-06ICML

用快速线性代数训练大模型,提升基因变异致病预测精度

Training Flexible Models of Genetic Variant Effects from Functional Annotations using Accelerated Linear Algebra

  • 基于快速线性代数构建深度模型,直接优化完整似然函数
  • 大模型+全似然训练显著提升预测性能,小模型效果无差别
  • 适合基因功能研究、疾病风险预测与药物靶点发现人群

理解人类基因组中遗传变异如何影响表型(如身高或哮喘等疾病)需要分析数十万个体的测序数据。科学家利用这些数据构建模型,根据变异的基因组特征(如染色质可及性或附近DNA结合蛋白存在情况)预测其对表型的影响。随着数据和特征增多,模型本应更准确,但受限于基因变异间的相关性导致的大矩阵求逆计算瓶颈,以往方法只能训练小型模型或拟合简化统计量而非完整似然。本文提出DeepWAS方法,借助现代快速线性代数技术,实现大型灵活神经网络模型在完整似然下的高效训练。结果表明:仅使用完整似然时,大模型才显著优于小模型;若仅拟合传统统计量,模型规模增大无法提升性能。包含更多特征的大模型能做出更好预测,有望提升疾病风险评估与治疗靶点识别能力。

原文摘要 · Abstract (English)

To understand how genetic variants in human genomes manifest in phenotypes -- traits like height or diseases like asthma -- geneticists have sequenced and measured hundreds of thousands of individuals. Geneticists use this data to build models that predict how a genetic variant impacts phenotype given genomic features of the variant, like DNA accessibility or the presence of nearby DNA-bound proteins. As more data and features become available, one might expect predictive models to improve. Unfortunately, training these models is bottlenecked by the need to solve expensive linear algebra problems because variants in the genome are correlated with nearby variants, requiring inversion of large matrices. Previous methods have therefore been restricted to fitting small models, and fitting simplified summary statistics, rather than the full likelihood of the statistical model. In this paper, we leverage modern fast linear algebra techniques to develop DeepWAS (Deep genome Wide Association Studies), a method to train large and flexible neural network predictive models to optimize likelihood. Notably, we find that larger models only improve performance when using our full likelihood approach; when trained by fitting traditional summary statistics, larger models perform no better than small ones. We find larger models trained on more features make better predictions, potentially improving disease predictions and therapeutic target identification.

基因预测深度学习线性代数遗传学

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。