arXiv:2501.16652cs.CVcs.AI2025-01被引 83

基于分子数据训练的病理学基础模型,可高效处理全切片图像并预测多种癌症任务。

Molecular-driven Foundation Model for Oncologic Pathology

  • 利用4.7万例组织切片的多模态数据预训练,融合染色与基因组信息。
  • 在54个肿瘤任务中表现优于所有基线,尤其擅长罕见事件预测。
  • 适合临床需求高、标注少的场景,推动精准医学发展。

基础模型正在重塑计算病理学,通过迁移学习使模型在大规模数据上预训练后可应用于下游诊断、预后和治疗反应任务。然而,现有模型仍难以在无需额外训练的情况下编码整个吉字节级全切片图像,且常缺乏互补的多模态数据。本文提出Threads,一个可在任意尺寸下生成全切片图像通用表征的切片级基础模型。该模型在包含47,171例苏木精-伊红(H&E)染色组织切片及其对应基因组和转录组数据的多样化队列上,采用多模态学习方法进行预训练,这是迄今用于基础模型开发的最大规模配对数据集。这种独特训练范式使Threads能够捕捉组织的潜在分子组成,生成适用于广泛下游任务的强大表征。在54个肿瘤任务的广泛基准测试中,包括临床分型、分级、突变预测、免疫组化状态判定、治疗反应预测和生存预测,Threads均超越所有基线,展现出卓越的泛化能力和标签效率,尤其擅长罕见事件预测,凸显其临床价值。研究团队计划向社区公开该模型。

原文摘要 · Abstract (English)

Foundation models are reshaping computational pathology by enabling transfer learning, where models pre-trained on vast datasets can be adapted for downstream diagnostic, prognostic, and therapeutic response tasks. Despite these advances, foundation models are still limited in their ability to encode the entire gigapixel whole-slide images without additional training and often lack complementary multimodal data. Here, we introduce Threads, a slide-level foundation model capable of generating universal representations of whole-slide images of any size. Threads was pre-trained using a multimodal learning approach on a diverse cohort of 47,171 hematoxylin and eosin (H&E)-stained tissue sections, paired with corresponding genomic and transcriptomic profiles - the largest such paired dataset to be used for foundation model development to date. This unique training paradigm enables Threads to capture the tissue's underlying molecular composition, yielding powerful representations applicable to a wide array of downstream tasks. In extensive benchmarking across 54 oncology tasks, including clinical subtyping, grading, mutation prediction, immunohistochemistry status determination, treatment response prediction, and survival prediction, Threads outperformed all baselines while demonstrating remarkable generalizability and label efficiency. It is particularly well suited for predicting rare events, further emphasizing its clinical utility. We intend to make the model publicly available for the broader community.

病理学基础模型多模态癌症预测

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。