无需参考图就能学习可变形形状的对比表示,提升医学图像分类精度
CoRLD: Contrastive Representation Learning Of Deformable Shapes In Images
- 在隐空间中用对比学习捕捉形状差异,不依赖测试时的模板图
- 在脑MRI和肾上腺CT数据上分类准确率显著提升
- 适合医疗影像中细微解剖变异分析,如疾病早期检测
可变形形状表示通过相对于模板的形变参数化,在图像分析任务中表现优异。但其广泛应用受限于两大挑战:一是现有方法测试时需已知模板,不切实际;二是难以区分相似形状间的细微差异(如健康、轻度认知障碍与病变个体间的解剖差异)。为此,我们提出一种新框架——在学习到的形变空间中进行可变形形状的对比表示学习(CoRLD),并验证其在图像分类中的有效性。CoRLD在潜在形变空间中采用类别感知的对比监督学习目标,促使同类别样本表示靠近,不同类别则分离。与以往需要输入参考图像预测形变变化的深度网络不同,本方法仅在训练时使用模板作为损失函数的真值,测试时无需依赖参考图,从而具备更强的灵活性与泛化能力。我们在多种数据集上验证了该方法,包括真实脑部磁共振成像(MRIs)及来自计算机断层扫描(CT)的肾上腺形状数据。实验结果表明,模型能有效提取可变形形状特征,并可轻松集成至现有分类器,显著提升分类准确率。代码已开源。
原文摘要 · Abstract (English)
Deformable shape representations, parameterized by deformations relative to a given template, have proven effective for improved image analysis tasks. However, their broader applicability is hindered by two major challenges. First, existing methods mainly rely on a known template during testing, which is impractical and limits flexibility. Second, they often struggle to capture fine-grained, voxel-level distinctions between similar shapes (e.g., anatomical variations among healthy individuals, those with mild cognitive impairment, and diseased states). To address these limitations, we propose a novel framework - Contrastive Representation Learning of Deformable shapes (CoRLD) in learned deformation spaces and demonstrate its effectiveness in the context of image classification. Our CoRLD leverages a class-aware contrastive supervised learning objective in latent deformation spaces, promoting proximity among representations of similar classes while ensuring separation of dissimilar groups. In contrast to previous deep learning networks that require a reference image as input to predict deformation changes, our approach eliminates this dependency. Instead, template images are utilized solely as ground truth in the loss function during the training process, making our model more flexible and generalizable to a wide range of medical applications. We validate CoRLD on diverse datasets, including real brain magnetic resonance imaging (MRIs) and adrenal shapes derived from computed tomography (CT) scans. Experimental results show that our model effectively extracts deformable shape features, which can be easily integrated with existing classifiers to substantially boost the classification accuracy. Our code is available at GitHub.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。