arXiv:2603.20708cs.CV2026-03中稿 · CVPR

用事件相机提升湍流消除质量与效率,少帧也能高清复原。

High-Quality and Efficient Turbulence Mitigation with Events

  • 利用事件信号的极性交替和时空连贯性,分离湍流与动态物体。
  • 仅需少量帧即实现高质量复原,数据开销减少77.3%。
  • 适合实时湍流抑制场景,如无人机视觉、红外成像等。

湍流消除(TM)因大气湍流的随机性而高度病态。现有方法依赖传统相机多帧采集以捕捉稳定模式,但存在精度与效率的权衡:帧数越多,复原越准,但系统延迟和数据开销也越大。事件相机具备微秒级时间分辨率,能高效感知动态变化,有望突破瓶颈。本文提出EHETM,基于事件信号在连续序列中建模运动的优势,发现两个关键现象:(1)湍流诱发的事件呈现与图像梯度相关的显著极性交替,可提供结构线索;(2)动态物体形成时空连贯的“事件管”,而湍流事件则呈不规则分布,可作为运动先验以分离物体与湍流。据此设计两个互补模块:极性加权梯度模块用于场景优化,事件管约束模块用于运动解耦,实现少帧下的高保真复原。此外,构建了两个真实世界事件-帧湍流数据集,涵盖大气与热成像场景。实验表明,EHETM优于现有最先进方法,尤其在含动态物体场景中表现突出,同时将数据开销和系统延迟分别降低约77.3%和89.5%。代码已开源:https://github.com/Xavier667/EHETM。

原文摘要 · Abstract (English)

Turbulence mitigation (TM) is highly ill-posed due to the stochastic nature of atmospheric turbulence. Most methods rely on multiple frames recorded by conventional cameras to capture stable patterns in natural scenarios. However, they inevitably suffer from a trade-off between accuracy and efficiency: more frames enhance restoration at the cost of higher system latency and larger data overhead. Event cameras, equipped with microsecond temporal resolution and efficient sensing of dynamic changes, offer an opportunity to break the bottleneck. In this work, we present EHETM, a high-quality and efficient TM method inspired by the superiority of events to model motions in continuous sequences. We discover two key phenomena: (1) turbulence-induced events exhibit distinct polarity alternation correlated with sharp image gradients, providing structural cues for restoring scenes; and (2) dynamic objects form spatiotemporally coherent ``event tubes'' in contrast to irregular patterns within turbulent events, providing motion priors for disentangling objects from turbulence. Based on these insights, we design two complementary modules that respectively leverage polarity-weighted gradients for scene refinement and event-tube constraints for motion decoupling, achieving high-quality restoration with few frames. Furthermore, we construct two real-world event-frame turbulence datasets covering atmospheric and thermal cases. Experiments show that EHETM outperforms SOTA methods, especially under scenes with dynamic objects, while reducing data overhead and system latency by approximately 77.3% and 89.5%, respectively. Our code is available at: https://github.com/Xavier667/EHETM.

湍流消除事件相机视频恢复动态物体

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。