用扩散模型生成可调控的RNA序列,提升翻译效率。
Latent Diffusion Models for Controllable RNA Sequence Generation
- 将RNA序列编码为潜在向量,用扩散模型生成并优化
- 生成的5'-UTR序列平均核糖体加载量(MRL)提升37.2%以上
- 适合需要高翻译效率的合成生物学与治疗设计场景
本文提出RNAdiffusion,一种用于生成和优化可变长度离散RNA序列的潜在扩散模型。RNA作为DNA与蛋白质间的中介,具有高度序列多样性及复杂三维结构以支持多种功能。我们利用预训练的BERT类模型将原始RNA序列编码为具有生物学意义的分词级表示,并采用查询变换器将其压缩为固定长度的潜在向量,再通过自回归解码器从这些潜在变量重建RNA序列。随后在该潜在空间中构建连续扩散模型。为实现优化,我们将奖励模型(代理RNA功能属性)的梯度融入反向扩散过程,从而生成高奖励得分的RNA序列。实验表明,RNAdiffusion生成的非编码RNA在多个生物指标上符合自然分布。进一步在mRNA 5'非翻译区(5'-UTRs)上微调并优化序列以提高翻译效率,其生成的序列平均核糖体加载量(MRL)与翻译效率(TE)显著优于基线模型,在奖励与结构稳定性之间取得更好平衡。研究成果对推动RNA序列-功能研究及治疗性RNA设计具有潜力。
原文摘要 · Abstract (English)
This work presents RNAdiffusion, a latent diffusion model for generating and optimizing discrete RNA sequences of variable lengths. RNA is a key intermediary between DNA and protein, exhibiting high sequence diversity and complex three-dimensional structures to support a wide range of functions. We utilize pretrained BERT-type models to encode raw RNA sequences into token-level, biologically meaningful representations. A Query Transformer is employed to compress such representations into a set of fixed-length latent vectors, with an autoregressive decoder trained to reconstruct RNA sequences from these latent variables. We then develop a continuous diffusion model within this latent space. To enable optimization, we integrate the gradients of reward models--surrogates for RNA functional properties--into the backward diffusion process, thereby generating RNAs with high reward scores. Empirical results confirm that RNAdiffusion generates non-coding RNAs that align with natural distributions across various biological metrics. Further, we fine-tune the diffusion model on mRNA 5' untranslated regions (5'-UTRs) and optimize sequences for high translation efficiencies. Our guided diffusion model effectively generates diverse 5'-UTRs with high Mean Ribosome Loading (MRL) and Translation Efficiency (TE), outperforming baselines in balancing rewards and structural stability trade-off. Our findings hold potential for advancing RNA sequence-function research and therapeutic RNA design.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。