arXiv:2601.12820cs.CV2026-01

首个面向全身PET/CT的通用基础模型,实现精准诊断与代谢网络分析

A Generalist Foundation Model for Total-body PET/CT Enables Diagnostic Reporting and System-wide Metabolic Profiling

  • 双流架构分离处理CT与PET,跨模态交互融合解剖与代谢信息
  • 在10,000+患者数据上预训练,肿瘤分割与低剂量病灶检测均优于基线
  • 可生成多语言报告并揭示器官间代谢关联,适合癌症系统诊疗研究

全身PET/CT实现全身分子成像,但异质性解剖与代谢信号、约2米轴向覆盖范围以及结构化放射科语义,挑战了现有医学AI模型——这些模型通常假设单模态输入、局部视场和粗粒度图文对齐。我们提出SDF-HOLO(系统性双流融合全息模型),一个用于全身PET/CT的多模态基础模型,在超过10,000名患者数据上预训练。SDF-HOLO采用双流编码器解耦CT与PET表征学习,并通过跨模态交互模块耦合,使解剖上下文优化PET聚合,代谢显著性引导细微形态推理。为建模长程身体依赖关系,层级上下文建模结合高效局部窗口与全局注意力。为连接体素与临床语言,我们使用解剖分割掩码作为显式语义锚点,并在预训练中执行体素-掩码-文本对齐。在肿瘤分割、低剂量病灶检测及多语言诊断报告生成任务中,SDF-HOLO超越强基线模型,降低定位误差与幻觉发现。除聚焦解读外,该模型支持全身代谢谱分析,揭示肿瘤相关的器官间代谢网络互作指纹,为全身PET/CT诊断与系统级精准肿瘤学提供可扩展计算基础。

原文摘要 · Abstract (English)

Total-body PET/CT enables system-wide molecular imaging, but heterogeneous anatomical and metabolic signals, approximately 2 m axial coverage, and structured radiology semantics challenge existing medical AI models that assume single-modality inputs, localized fields of view, and coarse image-text alignment. We introduce SDF-HOLO (Systemic Dual-stream Fusion Holo Model), a multimodal foundation model for holistic total-body PET/CT, pre-trained on more than 10,000 patients. SDF-HOLO decouples CT and PET representation learning with dual-stream encoders and couples them through a cross-modal interaction module, allowing anatomical context to refine PET aggregation while metabolic saliency guides subtle morphological reasoning. To model long-range dependencies across the body, hierarchical context modeling combines efficient local windows with global attention. To bridge voxels and clinical language, we use anatomical segmentation masks as explicit semantic anchors and perform voxel-mask-text alignment during pre-training. Across tumor segmentation, low-dose lesion detection, and multilingual diagnostic report generation, SDF-HOLO outperforms strong task-specific and clinical-reference baselines while reducing localization errors and hallucinated findings. Beyond focal interpretation, the model enables system-wide metabolic profiling and reveals tumor-associated fingerprints of inter-organ metabolic network interactions, providing a scalable computational foundation for total-body PET/CT diagnostics and system-level precision oncology.

全身成像PET/CT多模态精准肿瘤学

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。