通过语义分割对比学习,高效提取胸片特征,无需复杂增强和额外模块。
Efficient Chest X-ray Representation Learning via Semantic-Partitioned Contrastive Learning
- 将胸片分块为两部分,让模型从局部推断整体结构与病灶信息。
- 在多个数据集上表现媲美顶尖方法,计算量最低且精度更高。
- 适合资源受限场景,也适用于医疗影像的自监督预训练任务。
自监督学习(SSL)在标注有限的胸片分析中展现出强大潜力,但现有策略对医学影像仍不理想。掩码图像建模需大量计算重建高频背景细节,诊断价值低;对比学习常依赖剧烈增强,可能改变临床有意义结构。本文提出语义分割对比学习(S-PCL),一种专为胸片表征学习设计的高效预训练框架。S-PCL将单张胸片的补丁标记随机划分为两个无重叠的语义子集,每部分提供互补但不完整的视图。编码器需最大化两子集间的一致性,从而隐式推断全局解剖布局与局部病灶线索。该语义分割形成内部瓶颈,强制建模长程依赖与结构一致性。S-PCL无需手工增强、辅助解码器或动量编码器,架构精简、计算高效、易于扩展。在ChestX-ray14、CheXpert、RSNA Pneumonia和SIIM-ACR Pneumothorax等大规模胸片基准上的实验表明,S-PCL性能可比肩先进方法,同时实现最低的GFLOPs与最优精度。
原文摘要 · Abstract (English)
Self-supervised learning (SSL) has emerged as a powerful paradigm for Chest X-ray (CXR) analysis under limited annotations. Yet, existing SSL strategies remain suboptimal for medical imaging. Masked image modeling allocates substantial computation to reconstructing high-frequency background details with limited diagnostic value. Contrastive learning, on the other hand, often depends on aggressive augmentations that risk altering clinically meaningful structures. We introduce Semantic-Partitioned Contrastive Learning (S-PCL), an efficient pre-training framework tailored for CXR representation learning. Instead of reconstructing pixels or relying on heavy augmentations, S-PCL randomly partitions patch tokens from a single CXR into two non-overlapping semantic subsets. Each subset provides a complementary but incomplete view. The encoder must maximize agreement between these partitions, implicitly inferring global anatomical layout and local pathological cues from partial evidence. This semantic partitioning forms an internal bottleneck that enforces long-range dependency modeling and structural coherence. S-PCL eliminates the need for hand-crafted augmentations, auxiliary decoders, and momentum encoders. The resulting architecture is streamlined, computationally efficient, and easy to scale. Extensive experiments on large-scale CXR benchmarks, including ChestX-ray14, CheXpert, RSNA Pneumonia and SIIM-ACR Pneumothorax, show that S-PCL achieves competitive performance while attaining the lowest GFLOPs and superior accuracy among existing SSL approaches.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。