轻量通道独立模型在多标记组织图像中表现更优。
Preserving Marker Specificity with Lightweight Channel-Independent Representation Learning
- 采用分离通道的浅层结构,保留蛋白标记特异性。
- 仅5.5K参数的CIM-S模型在49标记数据上表现超越深度模型。
- 适合稀有细胞识别等需要保持标记独立性的任务。
多标记组织成像每细胞可测量数十种蛋白标记,但多数深度学习模型仍采用早期通道融合,假设标记间存在共享结构。本文研究在多标记数据中,保留标记独立性并结合刻意浅层架构,是否比增加模型规模更适合作为自监督表示学习的归纳偏置。基于含14.5万个细胞、49个标记的霍奇金淋巴瘤CODEX数据集,对比标准早期融合CNN与通道分离架构,包括一种标记感知基线及本文提出的浅层通道独立模型(CIM-S,仅5.5K参数)。经对比预训练和线性评估后,早期融合模型难以保留标记特异性,尤其在稀有细胞判别上表现差。而通道独立架构,特别是CIM-S,在紧凑规模下实现显著更强的表征能力。该结论在多种自监督框架、不同增强设置下均稳定,并在49标记与18标记子集上均可复现。结果表明,轻量级通道独立架构可匹配甚至超越深层早期融合CNN与基础模型在多标记表示学习中的表现。代码已公开于https://github.com/SimonBon/CIM-S。
原文摘要 · Abstract (English)
Multiplexed tissue imaging measures dozens of protein markers per cell, yet most deep learning models still apply early channel fusion, assuming shared structure across markers. We investigate whether preserving marker independence, combined with deliberately shallow architectures, provides a more suitable inductive bias for self-supervised representation learning in multiplex data than increasing model scale. Using a Hodgkin lymphoma CODEX dataset with 145,000 cells and 49 markers, we compare standard early-fusion CNNs with channel-separated architectures, including a marker-aware baseline and our novel shallow Channel-Independent Model (CIM-S) with 5.5K parameters. After contrastive pretraining and linear evaluation, early-fusion models show limited ability to retain marker-specific information and struggle particularly with rare-cell discrimination. Channel-independent architectures, and CIM-S in particular, achieve substantially stronger representations despite their compact size. These findings are consistent across multiple self-supervised frameworks, remain stable across augmentation settings, and are reproducible across both the 49-marker and reduced 18-marker settings. These results show that lightweight, channel-independent architectures can match or surpass deep early-fusion CNNs and foundation models for multiplex representation learning. Code is available at https://github.com/SimonBon/CIM-S.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。