arXiv:2605.07810physics.opticscs.CV2026-05

用预训练提升光学图像去噪质量,实现高效无电处理。

Pre-training Enables Extraordinary All-optical Image Denoising

论文配图:Pre-training Enables Extraordinary All-optical Image Denoising
图 1 · 摘自论文原文
  • 先用345万张简单图像预训练光学网络,再微调适配具体任务。
  • 在信噪比低于8 dB的严重噪声下,去噪后PSNR提升至18 dB以上。
  • 同一模型可通用处理手写数字、X光片、人脸等多类图像,适合部署于边缘设备。

光学神经网络因其速度和能效优势正成为新兴的机器学习与信息处理工具,但其训练方法相比数字模型仍不成熟,导致性能欠佳。本文提出一种基于预训练的全光学图像去噪方法,通过两步优化:首先使用包含345万张多样化简单图像的大规模数据集进行预训练,再结合特定任务数据集进行微调。该迁移学习策略在严重噪声(峰值信噪比低于8 dB)条件下显著优于传统傅里叶域滤波和直接训练的衍射网络,有效保留图像细节,将去噪后PSNR提升至18 dB以上。更重要的是,同一预训练光学网络可一致微调用于处理来自不同风格的退化图像,涵盖手写数字(MNIST)、胸部X光片(ChestMNIST)、CIFAR-10图像及人脸(CelebA)。我们进一步验证了该光学去噪器在视觉应用中的关键作用,包括在噪声环境下的人脸检测、车牌识别及无人机定位。

原文摘要 · Abstract (English)

Optical neural networks are emerging as powerful machine learning and information processing tools because of their potential advantages in speed and energy efficiency. The training methods of these physical models, however, remain underexplored compared to their digital counterparts and are leading to suboptimal performance. This paper reports a pre-training-driven approach that leads to snapshot image denoising with substantially improved quality. We demonstrated effective free-space optical denoising by a diffractive network optimized by a two-step process including (1) pre-training using a massive dataset of 3.45 million diverse but simple images and (2) fine-tuning with the corresponding task-specific datasets. Compared to conventional Fourier-domain filtering and directly trained diffractive networks, such a transfer learning process exhibited prominent advantages for denoising images degraded by severe noise, peak signal-to-noise ratio (PSNR) below 8 dB, while preserving fine image features and improving the PSNR to above 18 dB. Importantly, the same pre-trained optical network could be consistently fine-tuned to process degraded images from highly diverse styles ranging from handwritten digits (MNIST) and chest X-rays (ChestMNIST) to CIFAR-10 images and human faces (CelebA). We further demonstrated the critical role of our optical denoisers in vision-based applications, including face detection, plate recognition, and localization of UAVs in noisy conditions.

光学计算去噪预训练迁移学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。