arXiv:2508.00164eess.IVq-bio.QM2025-08被引 2

虚拟染色未必提升医学图像任务性能,取决于下游网络容量。

On the Utility of Virtual Staining for Downstream Applications as it relates to Task Network Capacity

  • 用深度学习将无标记图像转为虚拟荧光图像,模拟真实染色。
  • 当任务网络容量足够大时,虚拟染色反而降低分割与分类效果。
  • 提醒研究者:是否使用虚拟染色需评估下游模型的能力。

虚拟染色(即基于深度学习的图像到图像翻译)可从无标记图像生成合成荧光图像。以往研究多依赖结构相似性或信噪比等传统图像质量指标评估其效果。但在生物医学成像中,图像的核心目的是支持下游任务(如分割或分类)。本研究系统评估了虚拟染色对临床相关下游任务的影响,重点关注执行任务的深度神经网络的容量。在多个生物数据集上,对比了无标记、虚拟染色和真实荧光图像在任务性能上的表现。结果表明,虚拟染色的效用高度依赖于任务网络提取关键信息的能力,而这一能力与网络容量直接相关。当任务网络容量充分时,虚拟染色不仅无法提升性能,甚至会使其下降。因此,在决定是否采用虚拟染色时,必须考虑下游任务网络的容量。

原文摘要 · Abstract (English)

Virtual staining, or in-silico-labeling, has been proposed to computationally generate synthetic fluorescence images from label-free images by use of deep learning-based image-to-image translation networks. In most reported studies, virtually stained images have been assessed only using traditional image quality measures such as structural similarity or signal-to-noise ratio. However, in biomedical imaging, images are typically acquired to facilitate an image-based inference, which we refer to as a downstream biological or clinical task. This study systematically investigates the utility of virtual staining for facilitating clinically relevant downstream tasks (like segmentation or classification) with consideration of the capacity of the deep neural networks employed to perform the tasks. Comprehensive empirical evaluations were conducted using biological datasets, assessing task performance by use of label-free, virtually stained, and ground truth fluorescence images. The results demonstrated that the utility of virtual staining is largely dependent on the ability of the segmentation or classification task network to extract meaningful task-relevant information, which is related to the concept of network capacity. Examples are provided in which virtual staining does not improve, or even degrades, segmentation or classification performance when the capacity of the associated task network is sufficiently large. The results demonstrate that task network capacity should be considered when deciding whether to perform virtual staining.

虚拟染色图像生成下游任务网络容量

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。