arXiv:2509.03808cs.CV2025-09被引 4

用事件相机提升湍流消除效率,速度更快、模型更小。

EGTM: Event-guided Efficient Turbulence Mitigation

论文配图:EGTM: Event-guided Efficient Turbulence Mitigation
图 1 · 摘自论文原文
  • 基于事件流反向分布提取像素级无畸变引导信号
  • 模型规模缩小710倍,推理延迟降低214倍,性能仍领先
  • 首个真实世界事件驱动湍流消除数据集,适合高效视觉系统研究

湍流消除旨在去除大气湍流造成的随机畸变和模糊。现有深度学习方法依赖多帧退化图像中提取的‘幸运区域’进行融合,但需高容量网络学习有限帧率下的粗粒度湍流动态,计算与存储效率低。事件相机具备微秒级时间分辨率,可利用稀疏异步成像机制突破此瓶颈。本文提出‘事件幸运洞察’,揭示湍流畸变与事件流时空逆分布的相关性;在此基础上构建EGTM框架,从显式但噪声较大的湍流事件中提取像素级可靠无畸变引导信号,实现时间上的幸运融合。此外,构建首个真实世界事件驱动湍流消除数据采集系统,发布首个事件驱动湍流消除数据集。大量实验表明,本方法在模型大小、推理延迟和模型复杂度上分别优于现有最先进方法710倍、214倍和224倍,同时在真实数据集上达到最优重建质量(PSNR提升0.94,SSIM提升0.08)。证明了引入事件模态在湍流消除任务中的巨大效率优势。

原文摘要 · Abstract (English)

Turbulence mitigation (TM) aims to remove the stochastic distortions and blurs introduced by atmospheric turbulence into frame cameras. Existing state-of-the-art deep-learning TM methods extract turbulence cues from multiple degraded frames to find the so-called "lucky'', not distorted patch, for "lucky fusion''. However, it requires high-capacity network to learn from coarse-grained turbulence dynamics between synchronous frames with limited frame-rate, thus fall short in computational and storage efficiency. Event cameras, with microsecond-level temporal resolution, have the potential to fundamentally address this bottleneck with efficient sparse and asynchronous imaging mechanism. In light of this, we (i) present the fundamental \textbf{``event-lucky insight''} to reveal the correlation between turbulence distortions and inverse spatiotemporal distribution of event streams. Then, build upon this insight, we (ii) propose a novel EGTM framework that extracts pixel-level reliable turbulence-free guidance from the explicit but noisy turbulent events for temporal lucky fusion. Moreover, we (iii) build the first turbulence data acquisition system to contribute the first real-world event-driven TM dataset. Extensive experimental results demonstrate that our approach significantly surpass the existing SOTA TM method by 710 times, 214 times and 224 times in model size, inference latency and model complexity respectively, while achieving the state-of-the-art in restoration quality (+0.94 PSNR and +0.08 SSIM) on our real-world EGTM dataset. This demonstrating the great efficiency merit of introducing event modality into TM task. Demo code and data have been uploaded in supplementary material and will be released once accepted.

湍流消除事件相机高效算法视觉重建

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。