用物理模型+对抗域适应,无须成对数据就能清除扫描隧道显微镜图像噪声。
Physics-augmented Deep Learning with Adversarial Domain Adaptation: Applications to STM Image Denoising
- 利用物理模型生成虚拟清晰图像,结合GAN与循环一致性约束。
- 在真实与仿真数据间实现特征对齐和权重共享,提升去噪效果。
- 适合科研人员处理难以获取配对数据的科学成像问题。
图像去噪在医学成像和材料表征等科学领域至关重要,需从噪声数据中准确恢复底层结构。尽管监督式去噪已取得进展,但通常依赖大量成对的清晰-噪声图像训练;而无监督方法虽不需成对数据,却常需未配对的清晰图像,这在实际中并不总可得。本文提出一种物理增强的深度学习与对抗域适应框架(PDA-Net),用于无监督图像去噪,应用于真实扫描隧道显微镜(STM)图像。PDA-Net利用基础物理原理模拟并构想去噪后的清晰图像。基于生成对抗网络(GAN),引入循环一致性模块与域对抗模块,以应对缺乏成对训练数据的问题,并促进仿真与真实实验域之间的信息迁移。最后,通过特征对齐与权重共享技术,充分利用仿真与真实图像间的相似性,显著提升两个域中的去噪性能。实验表明,所提PDA-Net能有效提升STM图像质量,具有推动科学发现和加速量子材料实验研究的潜力。
原文摘要 · Abstract (English)
Image denoising is a critical task in various scientific fields such as medical imaging and material characterization, where the accurate recovery of underlying structures from noisy data is essential. Although supervised denoising techniques have achieved significant advancements, they typically require large datasets of paired clean-noisy images for training. Unsupervised methods, while not reliant on paired data, typically necessitate a set of unpaired clean images for training, which are not always accessible. In this paper, we propose a physics-augmented deep learning with adversarial domain adaption (PDA-Net) framework for unsupervised image denoising, with applications to denoise real-world scanning tunneling microscopy (STM) images. Our PDA-Net leverages the underlying physics to simulate and envision the ground truth for denoised STM images. Additionally, built upon Generative Adversarial Networks (GANs), we incorporate a cycle-consistency module and a domain adversarial module into our PDA-Net to address the challenge of lacking paired training data and achieve information transfer between the simulated and real experimental domains. Finally, we propose to implement feature alignment and weight-sharing techniques to fully exploit the similarity between simulated and real experimental images, thereby enhancing the denoising performance in both the simulation and experimental domains. Experimental results demonstrate that the proposed PDA-Net successfully enhances the quality of STM images, offering promising applications to enhance scientific discovery and accelerate experimental quantum material research.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。