arXiv:2509.21376cs.CVcs.AI2025-09

用深度学习提升无标记显微图像分辨率,不同网络适配不同信噪比。

In silico Deep Learning Protocols for Label-Free Super-Resolution Microscopy: A Comparative Study of Network Architectures and SNR Dependence

  • 对比O-Net与Theta-Net在无荧光显微图像超分辨中的表现。
  • 高信噪比时O-Net效果更好,低信噪比则Theta-Net更优。
  • 揭示模型架构与图像质量的匹配关系,指导实际应用选择。

光学显微镜在教育、医疗、质检等领域广泛应用,但其横向分辨率通常受限于约200nm。传统超分辨技术需昂贵设备或特殊方法,难以普及。本研究探索一种经济可行的替代方案:利用非荧光相位调制成像(如泽尼克相衬、偏振干涉对比)结合深度神经网络实现超分辨。评估了此前提出的O-Net与Theta-Net两种网络架构,在原子力显微镜(AFM)校准的纳米结构测试靶上的表现。结果表明,尽管两者均有效,但具有互补性:高信噪比下O-Net性能更优,低信噪比时则偏好Theta-Net。该发现强调了模型架构与源图像信噪比共同影响超分辨效果,即使使用相同训练数据与训练轮次,也需根据条件合理选择模型。

原文摘要 · Abstract (English)

The field of optical microscopy spans across numerous industries and research domains, ranging from education to healthcare, quality inspection and analysis. Nonetheless, a key limitation often cited by optical microscopists refers to the limit of its lateral resolution (typically defined as ~200nm), with potential circumventions involving either costly external modules (e.g. confocal scan heads, etc) and/or specialized techniques [e.g. super-resolution (SR) fluorescent microscopy]. Addressing these challenges in a normal (non-specialist) context thus remains an aspect outside the scope of most microscope users & facilities. This study thus seeks to evaluate an alternative & economical approach to achieving SR optical microscopy, involving non-fluorescent phase-modulated microscopical modalities such as Zernike phase contrast (PCM) and differential interference contrast (DIC) microscopy. Two in silico deep neural network (DNN) architectures which we developed previously (termed O-Net and Theta-Net) are assessed on their abilities to resolve a custom-fabricated test target containing nanoscale features calibrated via atomic force microscopy (AFM). The results of our study demonstrate that although both O-Net and Theta-Net seemingly performed well when super-resolving these images, they were complementary (rather than competing) approaches to be considered for image SR, particularly under different image signal-to-noise ratios (SNRs). High image SNRs favoured the application of O-Net models, while low SNRs inclined preferentially towards Theta-Net models. These findings demonstrate the importance of model architectures (in conjunction with the source image SNR) on model performance and the SR quality of the generated images where DNN models are utilized for non-fluorescent optical nanoscopy, even where the same training dataset & number of epochs are being used.

超分辨显微深度学习无标记成像图像重建

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。