提出scSplit,让显微图像分解能自适应不同荧光重叠强度。
scSplit: Bringing Severity Cognizance to Image Decomposition in Fluorescence Microscopy
- 基于回归网络预测图像重叠程度,实现对混合比的感知。
- 引入退化特异性归一化模块,提升不同强度下的分解效果。
- 在5个公开数据集上验证,适用于图像拆分与荧光串扰去除。
荧光显微镜虽推动生命科学进步,但存在技术局限。计算多路复用技术可将多个细胞结构合并成单张图像并后续解混。现有图像分解方法在固定强度比的合成图像上训练,无法感知真实场景中未知的相对强度变化。本文提出scSplit,通过融合InDI迭代恢复方法与可学习回归器,首次实现对混合比(退化水平)的感知。该方法包含:(i) 训练好的回归网络,用于预测输入图像的混合比例;(ii) 退化特定归一化模块,支持跨不同混合比的鲁棒推理。实验表明,scSplit可有效完成图像拆分与荧光串扰去除任务,在5个公共数据集上均取得良好表现。源码与预训练模型已开源于https://github.com/juglab/scSplit/。
原文摘要 · Abstract (English)
Fluorescence microscopy, while being a key driver for progress in the life sciences, is also subject to technical limitations. To overcome them, computational multiplexing techniques have recently been proposed, which allow multiple cellular structures to be captured in a single image and later be unmixed. Existing image decomposition methods are trained on a set of superimposed input images and the respective unmixed target images. It is critical to note that the relative strength (mixing ratio) of the superimposed images for a given input is a priori unknown. However, existing methods are trained on a fixed intensity ratio of superimposed inputs, making them not cognizant of the range of relative intensities that can occur in fluorescence microscopy. In this work, we propose a novel method called scSplit that is cognizant of the severity of the above-mentioned mixing ratio. Our idea is based on InDI , a popular iterative method for image restoration, and an ideal starting point to embrace the unknown mixing ratio in any given input. We introduce (i) a suitably trained regressor network that predicts the degradation level (mixing ratio) of a given input image and (ii) a degradation-specific normalization module, enabling degradation-aware inference across all mixing ratios. We show that this method solves two relevant tasks in fluorescence microscopy, namely image splitting and bleedthrough removal, and empirically demonstrate the applicability of scSplit on 5 public datasets. The source code with pre-trained models is hosted at https://github.com/juglab/scSplit/.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。