用时间衰减模型补全缺失的肿瘤增强图像,提升低剂量扫描下的诊断准确率。
TARDis: Time Attenuated Representation Disentanglement for Incomplete Multi-Modal Tumor Segmentation and Classification
- 将缺失扫描阶段视为连续时间曲线上的缺损点,分离解剖与灌注特征
- 在2282例腹部CT上验证,极端数据稀疏下仍保持高诊断精度
- 适合低辐射剂量、多中心数据不一致的临床场景
对比增强计算机断层扫描(CT)中肿瘤的精准诊断与分割依赖于造影剂随时间变化的血流动力学特征。然而,临床实践中受限于辐射剂量约束和机构间采集协议差异,完整的时间动态常难以获取,导致普遍存在的模态缺失问题。现有深度学习方法通常将缺失阶段视为独立缺失通道,忽略了血流动力学的时间连续性。本文提出时间衰减表征解耦(TARDis),一种物理感知新框架,将缺失模态重新定义为连续时间-衰减曲线上的缺失采样点。我们假设潜在表征可解耦为时间不变的静态成分(解剖结构)和时间相关的动态成分(灌注)。通过双路径架构实现:基于量化的方法使用可学习嵌入字典提取一致解剖结构;概率路径采用血流动力学条件变分自编码器,根据估计扫描时间建模动态增强。该设计使网络可通过从学习到的潜在分布中采样来推断缺失的血流动力学特征。在包含2282名患者的大型私有腹部CT数据集及两个公开数据集上的大量实验表明,TARDis显著优于当前最先进的不完整模态框架。尤其在极端数据稀疏场景下,仍保持稳健的诊断性能,展现出在降低辐射暴露的同时维持诊断精度的潜力。
原文摘要 · Abstract (English)
The accurate diagnosis and segmentation of tumors in contrast-enhanced Computed Tomography (CT) are fundamentally driven by the distinctive hemodynamic profiles of contrast agents over time. However, in real-world clinical practice, complete temporal dynamics are often hard to capture by strict radiation dose limits and inconsistent acquisition protocols across institutions, leading to a prevalent missing modality problem. Existing deep learning approaches typically treat missing phases as absent independent channels, ignoring the inherent temporal continuity of hemodynamics. In this work, we propose Time Attenuated Representation Disentanglement (TARDis), a novel physics-aware framework that redefines missing modalities as missing sample points on a continuous Time-Attenuation Curve. We first hypothesize that the latent feature can be disentangled into a time-invariant static component (anatomy) and a time-dependent dynamic component (perfusion). We achieve this via a dual-path architecture: a quantization-based path using a learnable embedding dictionary to extract consistent anatomical structures, and a probabilistic path using a Hemodynamic Conditional Variational Autoencoder to model dynamic enhancement conditioned on the estimated scan time. This design allows the network to infer missing hemodynamic features by sampling from the learned latent distribution. Extensive experiments on a large-scale multi-modal private abdominal CT dataset (2,282 patients) and two public datasets demonstrate that TARDis significantly outperforms state-of-the-art incomplete modality frameworks. Notably, our method maintains robust diagnostic performance even in extreme data-sparsity scenarios, highlighting its potential for reducing radiation exposure while maintaining diagnostic precision.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。