用相似图像自动迁移参数,让显微镜去噪更省时高效
Automating Parameter Selection in Deep Image Prior for Fluorescence Microscopy Image Denoising via Similarity-Based Parameter Transfer
- 基于图像元数据相似性,自动转移最佳去噪参数
- 在多个数据集上优于原始DIP和主流变分去噪方法
- 特别适合处理高噪声显微图像,无需逐图调参
无监督深度图像先验(DIP)克服了监督学习对训练数据的依赖及泛化能力不足的问题。DIP性能受网络结构与迭代停止点影响,针对新图像优化参数耗时,限制其在需批量处理场景的应用。聚焦荧光显微图像去噪,我们假设语义相近的图像具有相似的最优DIP参数配置,可实现免优化的DIP应用。基于开源数据集构建了校准集(n=110)与验证集(n=55),用于搜索理想U-Net结构与停止点。校准集作为参数转移基础,验证集评估不同图像相似性准则的效果。提出AUTO-DIP自动参数迁移流程,对比原始DIP配置(基线)及先进图像特定变分去噪方法。结果表明,仅基于图像元数据相似性(如显微镜类型、样本类型)的参数转移,性能与定量相似性方法相当甚至更优。AUTO-DIP在多个复杂度不同的开源测试数据集上均优于基线DIP与变分去噪方法,尤其在极高噪声输入下表现突出。本地采集的显微图像应用进一步验证了其优越性。
原文摘要 · Abstract (English)
Unsupervised deep image prior (DIP) addresses shortcomings of training data requirements and limited generalization associated with supervised deep learning. The performance of DIP depends on the network architecture and the stopping point of its iterative process. Optimizing these parameters for a new image requires time, restricting DIP application in domains where many images need to be processed. Focusing on fluorescence microscopy data, we hypothesize that similar images share comparable optimal parameter configurations for DIP-based denoising, potentially enabling optimization-free DIP for fluorescence microscopy. We generated a calibration (n=110) and validation set (n=55) of semantically different images from an open-source dataset for a network architecture search targeted towards ideal U-net architectures and stopping points. The calibration set represented our transfer basis. The validation set enabled the assessment of which image similarity criterion yields the best results. We then implemented AUTO-DIP, a pipeline for automatic parameter transfer, and compared it to the originally published DIP configuration (baseline) and a state-of-the-art image-specific variational denoising approach. We show that a parameter transfer from the calibration dataset to a test image based on only image metadata similarity (e.g., microscope type, imaged specimen) leads to similar and better performance than a transfer based on quantitative image similarity measures. AUTO-DIP outperforms the baseline DIP (DIP with original DIP parameters) as well as the variational denoising approaches for several open-source test datasets of varying complexity, particularly for very noisy inputs. Applications to locally acquired fluorescence microscopy images further proved superiority of AUTO-DIP.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。