用小模型实现高精度蛋白-核酸结合预测,适合资源有限的研究者。
Compact Artificial Neural Network Models for Predicting Protein Residue -- RNA Base Binding
- 采用双层前馈网络加滑动窗口捕捉序列上下文,不依赖结构信息。
- 最优上下文窗口为30个残基/碱基,可平衡误报与漏报。
- 数据量增加和模型集成有效提升性能,适合普通实验室部署。
大型人工神经网络在文本、图像生成、药物发现及蛋白-RNA结合预测等任务中表现优异,但通常需要大量计算资源、时间和数据进行训练。由于许多研究者难以获得这些资源,且生命科学数据集常受限,本文探究小型神经网络在蛋白-RNA结合预测中能否达到可接受的准确率。实验采用仅含两层隐藏层的浅层前馈网络,使用不同非线性激活函数,未显式引入结构信息,而是通过滑动窗口隐式建模邻近残基与碱基的上下文。针对数据高度不平衡问题,测试了多种重采样策略,发现过采样与欠采样无效,而增加训练数据量和使用模型集成显著提升性能。在七种常用非线性函数中,仅ReLU、GLU与Tanh能实现模型收敛。最佳上下文窗口大小约为30个残基与碱基,兼顾假阳性与假阴性误差。结果表明,利用多数教育与科研机构可获取的硬件即可实现高精度蛋白-RNA结合预测。
原文摘要 · Abstract (English)
Large Artificial Neural Network (ANN) models have demonstrated success in various domains, including general text and image generation, drug discovery, and protein-RNA (ribonucleic acid) binding tasks. However, these models typically demand substantial computational resources, time, and data for effective training. Given that such extensive resources are often inaccessible to many researchers and that life sciences data sets are frequently limited, we investigated whether small ANN models could achieve acceptable accuracy in protein-RNA prediction. We experimented with shallow feed-forward ANNs comprising two hidden layers and various non-linearities. These models did not utilize explicit structural information; instead, a sliding window approach was employed to implicitly consider the context of neighboring residues and bases. We explored different training techniques to address the issue of highly unbalanced data. Among the seven most popular non-linearities for feed-forward ANNs, only three: Rectified Linear Unit (ReLU), Gated Linear Unit (GLU), and Hyperbolic Tangent (Tanh) yielded converging models. Common re-balancing techniques, such as under- and over-sampling of training sets, proved ineffective, whereas increasing the volume of training data and using model ensembles significantly improved performance. The optimal context window size, balancing both false negative and false positive errors, was found to be approximately 30 residues and bases. Our findings indicate that high-accuracy protein-RNA binding prediction is achievable using computing hardware accessible to most educational and research institutions.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。