arXiv:2606.29577cs.CVcs.AI2026-06

让脑PET图像学会识别代谢区域,生成可解释的医学报告。

ReMAP-PET: Beyond Visual Understanding -- Learning Region-Guided Metabolic Alignment Semantics from Brain PET

论文配图:ReMAP-PET: Beyond Visual Understanding -- Learning Region-Guided Metabolic Alignment Semantics from Brain PET
图 1 · 摘自论文原文
  • 用代谢区域标准摄取比数据监督模型,学习脑部代谢语义。
  • 在1015个样本上实现0.070的摄取误差和77.8%的召回率。
  • 能将影像直接转化为临床语言描述,适合医疗AI研究者。

正电子发射断层扫描(PET)揭示脑部代谢情况,是神经退行性疾病评估的核心手段。现有3D脑部基础模型将PET视为通用体数据,忽略了其结构化区域代谢特征,与结构影像的本质差异。为此,我们提出ReMAP-PET框架,通过联合回归与对比目标,以脑区标准化摄取比(SUVR)轮廓监督部分微调的MedicalNet 3D ResNet-50,使编码器学习到PET模态背后的代谢语义。在1015对配准的PET-SUVR样本上,ReMAP-PET达到0.070的SUVR MAE和77.8%的PET SUVR Recall@1,显著优于五个冻结预训练基线。进一步通过对比对齐冻结的BioClinicalBERT,将代谢嵌入连接至临床语言,并实现基于SUVR约束的端到端影像到报告生成。在线性探查诊断分类与认知回归任务中,嵌入无需特定任务微调即可保留临床相关性。结果表明,将PET编码器扎根于区域代谢语义,而非仅视作通用体数据,可获得结构化、可解释且语言兼容的表示,为代谢感知型PET理解开辟新方向。

原文摘要 · Abstract (English)

Positron Emission Tomography (PET) reveals brain metabolism and is clinically central to neurodegenerative disease assessment, yet existing 3D brain foundation models treat PET as generic volumetric data, missing the structured regional metabolic information that distinguishes it from structural neuroimaging. To address these limitations, we propose ReMAP-PET, a framework that moves beyond visual encoding by supervising a partially-tuned MedicalNet 3D ResNet-50 with brain regional standardized uptake value ratio (SUVR) profiles through joint regression and contrastive objectives, enabling the encoder to learn the metabolic semantics underlying PET modality. On 1015 paired PET--SUVR samples, ReMAP-PET achieves 0.070 SUVR MAE and 77.8% PET SUVR Recall@1, substantially outperforming five frozen pretrained baselines. We further connect the metabolic embedding to clinical language via contrastive alignment with frozen BioClinicalBERT and demonstrate end-to-end PET-to-report generation through SUVR-constrained verbalization. Linear probing on diagnostic classification and cognitive regression tasks confirms that the embeddings retain clinically relevant information without task-specific fine-tuning. Our results show that grounding PET encoders in regional metabolic semantics -- rather than treating PET as generic volumetric data -- yields representations that are structured, interpretable, and language-compatible, pointing to a new direction for metabolic-aware PET understanding.

脑PET代谢建模多模态生成医学表征

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。