arXiv:2607.18762cs.CV2026-07

用病理信息弱监督学习PET影像表征,提升肿瘤异质性检索能力。

Weakly Supervised Pathology-Informed Representation Learning for PET-Based Content Retrieval of Intra-Tumour Heterogeneity

  • 利用H&E信息训练,仅在推理时使用PET数据
  • 热点区域表征比全局表征提升检索性能
  • 适合关注肿瘤异质性分析的医学影像研究者

我们提出一种基于18F-FDG PET的弱监督表征学习框架,用于内容驱动的医学图像检索。训练阶段引入H&E衍生信息,但推理时仅使用PET数据。采用教师-学生策略学习肿瘤体素表征,生成全局与热点条件嵌入,并绘制食管癌病例中的瘤内异质性图谱。通过渐进式消融实验评估不同监督机制的贡献。使用平均精度、归一化折现累积增益和均倒数排名等指标评估跨验证折叠的检索性能。额外分析包括消融表现、热点忠实度(扰动/删除实验)、原型特异性18F-FDG摄取行为及学习到的PET原型类别与组织学特征之间的间接患者级一致性。逐步引入病理信息监督和热点建模后,相比全局PET表征和传统基线,检索性能显著提升。所有消融层级中,热点条件表征始终优于全局嵌入,表明聚焦关键肿瘤亚区可增强对瘤内异质性的敏感性。病理一致性分析显示,学习到的类别并非仅高摄取区域,而是展现出独特的18F-FDG摄取异质性。

原文摘要 · Abstract (English)

We propose a weakly supervised 18FFDG PET representation-learning framework for content based medical image retrieval, using H&E derived information during training while preserving PET-only inference. The proposed method was designed to use H&E derived information during training while maintaining PET only inference. A teacher student training strategy was used to learn the PET tumour derived voxel representations, from which global and hotspot conditioned embeddings were generated along with maps of intra tumour heterogeneity in our oesophegeal cancer test case. A progressive ablation strategy was used to evaluate the contribution of different supervision mechanisms. Retrieval performance was assessed across cross-validation folds using metrics including mean average precision, normalised discounted cumulative gain and mean reciprocal rank. Additional analyses evaluated ablation performance, hotspot faithfulness through perturbation/deletion experiments, prototype-specific PET uptake behaviour and indirect patient level concordance between learned PET prototype classes and selected histomic features. Progressive introduction of pathology informed supervision and hotspot modelling improved PET retrieval performance compared with global PET representations and conventional PET baselines. Across the ablation ladder, PET hotspot conditioned representations consistently provided stronger retrieval than global embeddings, indicating that focusing on informative tumour subregions improved sensitivity to intra tumour heterogeneity. Histopathology concordance further showed that the learned classes were not simply high uptake PET regions; instead, they demonstrated distinct heterogeneity in 18F FDG uptake.

PET影像肿瘤异质性弱监督表征学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。