提出连续曝光时间建模,让湍流模糊更真实,提升图像恢复效果。
Continuous Exposure-Time Modeling for Realistic Atmospheric Turbulence Synthesis
- 基于调制传递函数,建立曝光时间连续变化的模糊模型。
- 构建包含5083段视频的大规模合成数据集,支持多样光学条件。
- 训练模型在真实湍流数据上表现更好,适合视觉任务鲁棒性研究。
大气湍流通过几何扭曲和与曝光时间相关的模糊,严重降低远距离成像质量,影响视觉效果及高层视觉任务性能。现有合成方法通常简化模糊与曝光时间的关系,假设固定或二值化曝光,导致合成数据不真实且模型泛化能力差。为此,我们重新审视调制传递函数(MTF)形式,提出一种依赖曝光时间的新型MTF(ET-MTF),将模糊建模为曝光时间的连续函数。针对模糊合成,从ET-MTF推导出无倾斜点扩散函数(PSF),结合空间变化的模糊宽度场,实现对湍流引起的模糊的全面物理准确表征。基于此合成流程,构建了ET-Turb大规模合成湍流数据集,显式涵盖不同光学与大气条件下的连续曝光时间建模。该数据集包含5,083个视频(共2,005,835帧),分为3,988个训练视频和1,095个测试视频。大量实验表明,基于ET-Turb训练的模型在真实湍流数据上产生更逼真的修复结果,并实现更优的泛化性能。数据集已公开:github.com/Jun-Wei-Zeng/ET-Turb。
原文摘要 · Abstract (English)
Atmospheric turbulence significantly degrades long-range imaging by introducing geometric warping and exposure-time-dependent blur, which adversely affects both visual quality and the performance of high-level vision tasks. Existing methods for synthesizing turbulence effects often oversimplify the relationship between blur and exposure-time, typically assuming fixed or binary exposure settings. This leads to unrealistic synthetic data and limited generalization capability of trained models. To address this gap, we revisit the modulation transfer function (MTF) formulation and propose a novel Exposure-Time-dependent MTF (ET-MTF) that models blur as a continuous function of exposure-time. For blur synthesis, we derive a tilt-invariant point spread function (PSF) from the ET-MTF, which, when integrated with a spatially varying blur-width field, provides a comprehensive and physically accurate characterization of turbulence-induced blur. Building on this synthesis pipeline, we construct ET-Turb, a large-scale synthetic turbulence dataset that explicitly incorporates continuous exposure-time modeling across diverse optical and atmospheric conditions. The dataset comprises 5,083 videos (2,005,835 frames), partitioned into 3,988 training and 1,095 test videos. Extensive experiments demonstrate that models trained on ET-Turb produce more realistic restorations and achieve superior generalization on real-world turbulence data compared to those trained on other datasets. The dataset is publicly available at: github.com/Jun-Wei-Zeng/ET-Turb.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。