提出傅里叶全局去噪模型,智能去除显微图像噪声同时保留微弱物理特征。
A Fourier-Based Global Denoising Model for Smart Artifacts Removing of Microscopy Images
- 基于双输入通道与傅里叶损失函数,融合用户定义的权衡策略
- 在铜、硅、生物膜和塑料降解图像上显著提升信噪比,保留关键细节
- 适合材料科学实验者定制化去噪,兼顾专家偏好与物理信息保全
扫描隧道显微镜(STM)、原子力显微镜(AFM)和扫描电子显微镜(SEM)是获取微观至纳米尺度材料结构与物性关系的重要工具。然而,优化扫描速度、电流设定值、探针偏压等参数以获得高质量图像耗时且复杂。次优图像中的噪声与伪影会掩盖关键特征,导致分析错误。现有去噪模型通常将弱信号视为噪声而增强强信号,但在显微图像中并不总是成立,常导致重要物理信息被误删。为此,我们提出全局去噪模型(GDM),通过两个设计:1)构建非配对、目标特定预处理图像的双输入通道,支持用户自定义通道间权衡;2)结合像素级与快速傅里叶变换(FFT)损失函数,训练U-net模型。我们在铜(Cu)、硅(Si)的STM图像,潘多拉菌(Pantoea sp. YR343)生物膜的AFM图像,以及塑料降解的SEM图像上对比了该模型与非FFT去噪模型。结果表明,该方法能有效去除伪影并保留微弱但重要的物理特征,且设计灵活,可拓展至其他显微图像质量提升,助力实验人员根据领域知识智能调参。
原文摘要 · Abstract (English)
Microscopy such as Scanning Tunneling Microscopy (STM), Atomic Force Microscopy (AFM) and Scanning Electron Microscopy (SEM) are essential tools in material imaging at micro- and nanoscale resolutions to extract physical knowledge and materials structure-property relationships. However, tuning microscopy controls (e.g. scanning speed, current setpoint, tip bias etc.) to obtain a high-quality of images is a non-trivial and time-consuming effort. On the other hand, with sub-standard images, the key features are not accurately discovered due to noise and artifacts, leading to erroneous analysis. Existing denoising models mostly build on generalizing the weak signals as noises while the strong signals are enhanced as key features, which is not always the case in microscopy images, thus can completely erase a significant amount of hidden physical information. To address these limitations, we propose a global denoising model (GDM) to smartly remove artifacts of microscopy images while preserving weaker but physically important features. The proposed model is developed based on 1) first designing a two-imaging input channel of non-pair and goal specific pre-processed images with user-defined trade-off information between two channels and 2) then integrating a loss function of pixel- and fast Fourier-transformed (FFT) based on training the U-net model. We compared the proposed GDM with the non-FFT denoising model over STM-generated images of Copper(Cu) and Silicon(Si) materials, AFM-generated Pantoea sp.YR343 bio-film images and SEM-generated plastic degradation images. We believe this proposed workflow can be extended to improve other microscopy image quality and will benefit the experimentalists with the proposed design flexibility to smartly tune via domain-experts preferences.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。