用物理规律指导神经网络,精准修复显微镜深层成像的畸变。
Physics-Informed Graph Neural Networks for Frequency-Aware Optical Aberration Correction
- 基于波前物理关系构建图模型,学习时遵循光学原理。
- 在多种样本上实现顶尖图像恢复与系数预测效果。
- 适合需要高精度光学矫正的生物成像研究者。
光学像差严重降低显微镜成像质量,尤其在深层成像时更为显著。这些像差源于光波前畸变,可由泽尼克多项式数学表征。现有方法通常仅处理轻微像差,且局限于特定样本和模态,常将问题视为黑箱映射,未利用波前畸变的底层光学物理。本文提出ZRNet,一种融合物理先验的框架,联合预测泽尼克系数并恢复光学图像。我们设计了泽尼克图模块,显式建模泽尼克多项式间的物理关联(基于方位度),确保学习到的校正符合基本光学规律。为进一步强化图像恢复与泽尼克预测间的物理一致性,引入频域感知对齐损失(FAA),在傅里叶域更准确对齐系数预测与图像特征。在CytoImageNet上的大量实验表明,该方法在多种显微成像模态和复杂、大振幅像差的生物样本上均达到当前最优性能。进一步在真实显微镜点扩散函数(PSF)数据上验证,对实际传感器噪声具有鲁棒性,证明其超越模拟条件的泛化能力。代码已开源:https://github.com/janetkok/ZRNet。
原文摘要 · Abstract (English)
Optical aberrations significantly degrade image quality in microscopy, particularly when imaging deeper into samples. These aberrations arise from distortions in the optical wavefront and can be mathematically represented using Zernike polynomials. Existing methods often address only mild aberrations on limited sample types and modalities, typically treating the problem as a black-box mapping without leveraging the underlying optical physics of wavefront distortions. We propose ZRNet, a physics-informed framework that jointly performs Zernike coefficient prediction and optical image Restoration. We contribute a Zernike Graph module that explicitly models physical relationships between Zernike polynomials based on their azimuthal degrees-ensuring that learned corrections align with fundamental optical principles. To further enforce physical consistency between image restoration and Zernike prediction, we introduce a Frequency-Aware Alignment (FAA) loss, which better aligns Zernike coefficient prediction and image features in the Fourier domain. Extensive experiments on CytoImageNet demonstrates that our approach achieves state-of-the-art performance in both image restoration and Zernike coefficient prediction across diverse microscopy modalities and biological samples with complex, large-amplitude aberrations. We further validate on experimental PSF data from a physical microscope and demonstrate robustness to realistic sensor noise, confirming generalisation beyond simulated conditions. Code is available at https://github.com/janetkok/ZRNet.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。