用物理方程逐步优化图像去模糊,提升清晰度且几乎不增加计算量。
Physics-Informed Image Restoration via Progressive PDE Integration
- 引入偏微分方程建模运动模糊的流动方向,实现全局特征演化
- 在四种主流模型上均提升PSNR和SSIM,性能更稳定
- 仅增加1%推理算力,适合实际部署
运动模糊由拍摄时相机与场景相对运动引起,严重降低图像质量并影响动态环境中的目标检测、跟踪和识别等任务。尽管基于深度学习的方法取得了显著进展,但现有方法难以捕捉运动模糊中固有的长距离空间依赖性。传统卷积方法受限于有限的感受野,需极深网络建模全局关系。为此,本文提出一种融合物理先验的渐进式训练框架,将物理信息驱动的偏微分方程(PDE)动力学融入先进图像恢复架构。通过采用对流-扩散方程建模特征演化,该方法自然捕获运动模糊的方向流动特性,并实现有原则的全局空间建模。所提PDE增强型去模糊模型在仅增加约1%推理GMACs的前提下,显著提升多种主流架构的感知质量。在标准运动去模糊基准上的全面实验表明,该方法在四类不同架构(FFTformer、NAFNet、Restormer、Stripformer)上均显著提升PSNR与SSIM,验证了基于PDE的全局层可有效增强深度学习图像恢复能力,为计算机视觉中物理信息神经网络设计提供新方向。
原文摘要 · Abstract (English)
Motion blur, caused by relative movement between camera and scene during exposure, significantly degrades image quality and impairs downstream computer vision tasks such as object detection, tracking, and recognition in dynamic environments. While deep learning-based motion deblurring methods have achieved remarkable progress, existing approaches face fundamental challenges in capturing the long-range spatial dependencies inherent in motion blur patterns. Traditional convolutional methods rely on limited receptive fields and require extremely deep networks to model global spatial relationships. These limitations motivate the need for alternative approaches that incorporate physical priors to guide feature evolution during restoration. In this paper, we propose a progressive training framework that integrates physics-informed PDE dynamics into state-of-the-art restoration architectures. By leveraging advection-diffusion equations to model feature evolution, our approach naturally captures the directional flow characteristics of motion blur while enabling principled global spatial modeling. Our PDE-enhanced deblurring models achieve superior restoration quality with minimal overhead, adding only approximately 1\% to inference GMACs while providing consistent improvements in perceptual quality across multiple state-of-the-art architectures. Comprehensive experiments on standard motion deblurring benchmarks demonstrate that our physics-informed approach improves PSNR and SSIM significantly across four diverse architectures, including FFTformer, NAFNet, Restormer, and Stripformer. These results validate that incorporating mathematical physics principles through PDE-based global layers can enhance deep learning-based image restoration, establishing a promising direction for physics-informed neural network design in computer vision applications.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。