用图模型生成伪标签,让生物序列设计在数据少时仍有效
GROOT: Effective Design of Biological Sequences with Limited Experimental Data
- 基于邻域采样生成伪标签,通过图传播进行平滑优化
- 在少量实验数据下实现超越已有方法的序列设计性能
- 适合数据稀缺但需高效设计的生物工程研究者
潜在空间优化(LSO)是一种强大的方法,用于设计离散、高维的生物序列以最大化昂贵的黑箱函数(如湿实验)。其核心是利用已有数据学习潜在空间,并通过代理模型引导优化算法寻找最优输出。然而,当标注数据有限时,现有方法表现不佳:仅用少量标注点训练代理模型会导致输出质量低下,甚至不如原始训练数据。为此,本文提出GROOT——一种基于图的潜在空间平滑方法。GROOT在训练潜在嵌入周围采样邻域,生成伪标签,并通过标签传播对这些伪标签进行迭代细化与平滑。我们从理论上和实证上验证了该方法的有效性,证明GROOT能可靠地外推至训练集之外的区域,且其预测值始终处于距训练区域期望距离的上界之内。我们在多个生物序列设计任务中评估GROOT,包括蛋白质优化(GFP与AAV)以及来自Design-Bench的三项具有精确奥数器的任务。结果表明,GROOT无需访问黑箱奥数器或大量标注数据,即可达到并超越现有方法,展现出显著的实用性和有效性。代码已公开于https://anonymous.4open.science/r/GROOT-D554。
原文摘要 · Abstract (English)
Latent space optimization (LSO) is a powerful method for designing discrete, high-dimensional biological sequences that maximize expensive black-box functions, such as wet lab experiments. This is accomplished by learning a latent space from available data and using a surrogate model to guide optimization algorithms toward optimal outputs. However, existing methods struggle when labeled data is limited, as training the surrogate model with few labeled data points can lead to subpar outputs, offering no advantage over the training data itself. We address this challenge by introducing GROOT, a Graph-based Latent Smoothing for Biological Sequence Optimization. In particular, GROOT generates pseudo-labels for neighbors sampled around the training latent embeddings. These pseudo-labels are then refined and smoothed by Label Propagation. Additionally, we theoretically and empirically justify our approach, demonstrate GROOT's ability to extrapolate to regions beyond the training set while maintaining reliability within an upper bound of their expected distances from the training regions. We evaluate GROOT on various biological sequence design tasks, including protein optimization (GFP and AAV) and three tasks with exact oracles from Design-Bench. The results demonstrate that GROOT equalizes and surpasses existing methods without requiring access to black-box oracles or vast amounts of labeled data, highlighting its practicality and effectiveness. We release our code at https://anonymous.4open.science/r/GROOT-D554
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。