arXiv:2412.03026cs.CV2024-12CVPR被引 17

用一张2D ST片+3D病理切片,低成本还原3D基因表达图谱。

ASIGN: An Anatomy-aware Spatial Imputation Graphic Network for 3D Spatial Transcriptomics

  • 构建3D空间图网络,融合多层切片重叠与相似性提升空间建模。
  • 在3个公开数据集上实现当前最佳2D/3D重建精度,优于传统方法。
  • 适合需3D基因表达分析但预算有限的生物医学研究者使用。

空间转录组学(ST)是新兴技术,可让医学计算机视觉科学家自动解析形态特征背后的分子谱。然而,现有基于深度学习的分析大多局限于二维(2D)切片,因组织在三维(3D)中异质性易导致诊断误差。将ST扩展至3D体积成本高昂:单次2D ST获取费用超过全幻灯片成像(WSI)的50倍,10层3D体积成本可高一个数量级。为降低成本,科学家尝试直接从WSI预测ST数据,但效果不佳。为此,本文提出新问题:仅用3D WSI切片和单张2D ST片,实现3D ST数据补全。我们提出解剖感知的空间插补图网络(ASIGN),通过跨层重叠与相似性扩展,将2D空间关系延伸至3D,并设计多层级空间注意力图网络,整合不同数据源特征。在三个公开空间转录组数据集上评估,结果表明ASIGN在2D与3D场景下均达到当前最优性能。代码已开源:https://github.com/hrlblab/ASIGN。

原文摘要 · Abstract (English)

Spatial transcriptomics (ST) is an emerging technology that enables medical computer vision scientists to automatically interpret the molecular profiles underlying morphological features. Currently, however, most deep learning-based ST analyses are limited to two-dimensional (2D) sections, which can introduce diagnostic errors due to the heterogeneity of pathological tissues across 3D sections. Expanding ST to three-dimensional (3D) volumes is challenging due to the prohibitive costs; a 2D ST acquisition already costs over 50 times more than whole slide imaging (WSI), and a full 3D volume with 10 sections can be an order of magnitude more expensive. To reduce costs, scientists have attempted to predict ST data directly from WSI without performing actual ST acquisition. However, these methods typically yield unsatisfying results. To address this, we introduce a novel problem setting: 3D ST imputation using 3D WSI histology sections combined with a single 2D ST slide. To do so, we present the Anatomy-aware Spatial Imputation Graph Network (ASIGN) for more precise, yet affordable, 3D ST modeling. The ASIGN architecture extends existing 2D spatial relationships into 3D by leveraging cross-layer overlap and similarity-based expansion. Moreover, a multi-level spatial attention graph network integrates features comprehensively across different data sources. We evaluated ASIGN on three public spatial transcriptomics datasets, with experimental results demonstrating that ASIGN achieves state-of-the-art performance on both 2D and 3D scenarios. Code is available at https://github.com/hrlblab/ASIGN.

空间转录组3D重建图神经网络低成本建模

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。