用正交分解揭示PET与MRI的互补性,明确各自独特信息。
Bridging MRI and PET physiology: Untangling complementarity through orthogonal representations

- 将多模态融合转为正交子空间分离,区分共享与特有信息。
- 在13名前列腺癌患者中,肿瘤区残差最大,表明PET有不可由MRI还原的信号。
- 适合医学影像融合、精准诊疗及影像组学研究者阅读。
多模态影像分析常依赖联合潜在表示,但此类方法很少明确区分共享与模态特异性信息。厘清这一区别具有临床意义,可界定各模态不可替代的贡献并指导合理采集策略。本文提出一种子空间分解框架,将多模态融合重构为正交子空间分离问题而非映射转换。将前列腺特异性膜抗原(PSMA)PET摄取分解为可由MRI解释的生理包络与正交残差,后者反映无法在MRI特征流形内表达的信号成分。利用多参数MRI,训练基于强度的非空间隐式神经表示(INR),将MRI特征向量映射至PET摄取值。引入基于奇异值分解的投影正则化,惩罚位于MRI特征流形张成空间内的残差成分,强制组织水平生理属性(结构、扩散、灌注)与细胞内PSMA表达之间的数学正交性。在13名前列腺癌患者数据上测试,结果显示:由MRI特征张成的残差成分被纳入学习到的包络中,而正交残差在肿瘤区域最大,表明PSMA PET包含无法从MRI衍生的生理描述符中恢复的信号成分。该分解提供了一种基于表示几何的、结构化的模态互补性表征。
原文摘要 · Abstract (English)
Multimodal imaging analysis often relies on joint latent representations, yet these approaches rarely define what information is shared versus modality-specific. Clarifying this distinction is clinically relevant, as it delineates the irreducible contribution of each modality and informs rational acquisition strategies. We propose a subspace decomposition framework that reframes multimodal fusion as a problem of orthogonal subspace separation rather than translation. We decompose Prostate-Specific Membrane Antigen (PSMA) PET uptake into an MRI-explainable physiological envelope and an orthogonal residual reflecting signal components not expressible within the MRI feature manifold. Using multiparametric MRI, we train an intensity-based, non-spatial implicit neural representation (INR) to map MRI feature vectors to PET uptake. We introduce a projection-based regularization using singular value decomposition to penalize residual components lying within the span of the MRI feature manifold. This enforces mathematical orthogonality between tissue-level physiological properties (structure, diffusion, perfusion) and intracellular PSMA expression. Tested on 13 prostate cancer patients, the model demonstrates that residual components spanned by MRI features are absorbed into the learned envelope, while the orthogonal residual is largest in tumour regions. This indicates that PSMA PET contains signal components not recoverable from MRI-derived physiological descriptors. The resulting decomposition provides a structured characterization of modality complementarity grounded in representation geometry rather than image translation.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。