提出深度感知模拟与解耦恢复框架,提升单帧大气湍流图像修复效果。
D$^2$Turb: Depth-Aware Simulation and Decoupled Learning for Single-Frame Atmospheric Turbulence Mitigation

- 引入深度感知湍流模拟,生成符合物理规律的渐变退化图像。
- 分两阶段修复:先去模糊恢复纹理,再通过动态结构引导校正几何畸变。
- 在合成与真实数据集上均超越现有方法,适合图像增强与遥感领域应用。
单帧大气湍流抑制因空间变化的模糊与非刚性几何失真而本质病态。现有端到端方法在平坦场仿真上训练,常难以平衡纹理恢复与几何校正。为此,我们提出D²Turb,一个融合物理驱动模拟与显式解耦恢复的统一框架。首先,设计深度感知湍流生成协议,将场景深度融入相位到空间的映射中,生成具有深度依赖性的物理一致退化,并提供关键的中间倾斜监督信号以实现解耦学习。基于此仿真引擎,D²Turb将恢复过程分为两个交互阶段:纹理去模糊与几何校正。纹理去模糊阶段采用去模糊主干网络恢复细粒度细节,同时保留几何失真供后续校正使用。为缓解级联设计中的信息碎片问题,进一步提出自适应结构先验注入(ASPI)机制,动态传递去模糊模块的深层结构表征,指导密集光流预测以实现空间逆扭曲。大量实验表明,D²Turb在合成与真实世界数据集上均达到当前最优性能,且在纹理恢复与几何保真度方面均有稳定提升。代码与预训练模型已公开于https://github.com/HertzDot222/D2Turb。
原文摘要 · Abstract (English)
Single-frame atmospheric turbulence mitigation is inherently ill-posed due to spatially varying blur coupled with non-rigid geometric distortion. Existing end-to-end approaches trained on flat-field simulations often struggle to balance texture recovery with geometric rectification. To overcome this limitation, we propose D$^2$Turb, a unified framework that bridges physics-grounded simulation with explicitly decoupled restoration. First, we introduce a Depth-Aware Turbulence Synthesis protocol that incorporates scene depth into the phase-to-space formulation. This generates physically consistent, depth-dependent degradations and provides a crucial intermediate tilt supervision signal for disentangled learning. Building upon this simulation engine, D$^2$Turb decomposes restoration into two interactive stages: texture deblurring and geometric rectification. The texture deblurring stage employs a deblurring backbone to recover fine-grained details while preserving geometric distortion for the subsequent rectification stage. To mitigate the information fragmentation commonly observed in cascaded designs, we further propose an Adaptive Structural Prior Injection (ASPI) mechanism that dynamically transfers deep structural representations from the deblurring module to guide dense flow prediction for spatial unwarping. Extensive experiments demonstrate that D$^2$Turb achieves state-of-the-art performance on both synthetic and real-world datasets, with consistent improvements in both texture recovery and geometric fidelity. Our code and pre-trained models are publicly available at https://github.com/HertzDot222/D2Turb.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。