用大模型生成更准的分类标签,提升微生物注释精度
TaxDistill: Improving Metagenomic Taxonomic Annotation via Distilled Genomic Foundation Models

- 用5亿参数基因组基础模型生成软标签,减少传统比对工具带来的噪声
- 在7个CAMI2数据集上,胃肠道样本F1得分从0.763提升至0.941
- 适合需要高精度微生物分类的环境样本分析研究者使用
宏基因组分类旨在识别环境样本中DNA片段的微生物来源。传统基于序列相似性的方法受限于微生物多样性高和参考数据库不完整,催生了如Taxometer等学习型方法,通过后处理优化序列表征。但这些方法训练时依赖相似性搜索工具生成的标签,引入噪声,影响表征学习与分类性能。为此,我们提出TaxDistill,一种用于宏基因组分类的知识蒸馏框架。引入GenomeOcean(500M参数)作为教师模型,提取深层语义特征并生成置信度驱动的软标签。通过将软标签信息蒸馏至轻量学生网络,有效降低初始检索工具带来的标签噪声。在7个多样化的CAMI2数据集上进行综合实验表明,TaxDistill在多数场景下优于现有基线。例如,在胃肠道数据集上,其F1分数由MMseqs2的0.763提升至0.941,超过Taxometer基线。总体而言,TaxDistill为复杂宏基因组分析中的标签校正提供了一种可靠方法。
原文摘要 · Abstract (English)
Metagenomic taxonomic annotation aims to identify the microbial origins of DNA fragments in environmental samples. Traditional methods that rely on sequence similarity are often constrained by the high microbial diversity and the incompleteness of reference databases, which has motivated the development of learning approaches such as Taxometer that perform post hoc correction to learn more informative metagenomic sequence representations. However, these methods typically rely on labels derived from similarity search tools during training, which inevitably introduces noise that can impair representation learning and degrade classification performance. To address this issue, we propose TaxDistill, a knowledge distillation framework for metagenomic classification. We introduce GenomeOcean, a 500M parameter genomic foundation model, as the teacher network to extract deep semantic features and generate soft labels based on confidence. By distilling this soft label information into a lightweight student network, TaxDistill effectively reduces the label noise introduced by initial retrieval tools. Comprehensive experiments on seven diverse CAMI2 datasets demonstrate that TaxDistill outperforms existing baselines in most scenarios. For instance, on the Gastrointestinal dataset, it improves the F1 score of MMseqs2 from 0.763 to 0.941, outperforming the Taxometer baseline. Overall, TaxDistill provides a reliable method for label correction in complex metagenomic analysis.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。