提出C3R框架,实现显微图像跨数据集统一评估
C3R: Channel Conditioned Cell Representations for unified evaluation in microscopy imaging
- 按上下文与概念通道分组,构建通道条件化表征
- 在分布内和分布外数据上均超越现有基准
- 无需微调即可跨不同染色配置的显微图像应用
免疫组织化学(IHC)图像在亚细胞层面揭示结构与功能信息,但因实验室间染色协议差异导致通道数量和配置不一致,给深度学习模型带来挑战。现有方法虽具通道自适应能力,却无法支持跨数据集的分布外(OOD)评估,且无法在通道数不匹配时实现真正零样本应用。为此,本文提出将图像通道划分为上下文通道与概念通道,并以上下文为参考构建通道条件化细胞表征(C3R)。C3R采用双阶段框架:通道自适应编码器与掩码知识蒸馏训练策略,均基于上下文-概念原则。实验表明,该方法在分布内(ID)与分布外(OOD)任务中均优于现有基准;即使简化版本也超越了CHAMMI基准上报告的通道自适应方法。本方法为无须数据集特异性适配或重训练的IHC数据集间泛化提供了新路径。
原文摘要 · Abstract (English)
Immunohistochemical (IHC) images reveal detailed information about structures and functions at the subcellular level. However, unlike natural images, IHC datasets pose challenges for deep learning models due to their inconsistencies in channel count and configuration, stemming from varying staining protocols across laboratories and studies. Existing approaches build channel-adaptive models, which unfortunately fail to support out-of-distribution (OOD) evaluation across IHC datasets and cannot be applied in a true zero-shot setting with mismatched channel counts. To address this, we introduce a structured view of cellular image channels by grouping them into either context or concept, where we treat the context channels as a reference to the concept channels in the image. We leverage this context-concept principle to develop Channel Conditioned Cell Representations (C3R), a framework designed for unified evaluation on in-distribution (ID) and OOD datasets. C3R is a two-fold framework comprising a channel-adaptive encoder architecture and a masked knowledge distillation training strategy, both built around the context-concept principle. We find that C3R outperforms existing benchmarks on both ID and OOD tasks, while a trivial implementation of our core idea also outperforms the channel-adaptive methods reported on the CHAMMI benchmark. Our method opens a new pathway for cross-dataset generalization between IHC datasets, without requiring dataset-specific adaptation or retraining.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。