arXiv:2510.22565eess.IVcs.CV2025-10中稿 · BMVC2025

用事件相机提升模糊低帧率视频插帧质量

Learning Event-guided Exposure-agnostic Video Frame Interpolation via Adaptive Feature Blending

  • 通过自适应采样和重要性映射融合事件信息
  • 在真实与合成数据上均显著改善插帧效果
  • 适合处理未知曝光条件下的低帧率视频

曝光无关视频帧插值(VFI)旨在从模糊、低帧率输入中恢复清晰的高帧率视频,尤其在未知且动态的曝光条件下极具挑战。事件相机具有高时间分辨率,为此任务提供了优势。然而,现有事件引导方法在严重低帧率模糊视频上表现不佳,因缺乏时间约束。本文提出一种新颖的事件引导框架,包含两个核心组件:目标自适应事件采样(TES)和目标自适应重要性映射(TIM)。TES在目标时间戳及未知曝光时间附近采样事件,使其更对齐模糊帧;TIM则生成考虑时序接近性和空间相关性的权重图,指导连续特征的自适应融合,使时序对齐特征为主导,空间相关特征提供补充支持。在合成与真实数据集上的大量实验表明,该方法在曝光无关场景下有效提升了插帧性能。

原文摘要 · Abstract (English)

Exposure-agnostic video frame interpolation (VFI) is a challenging task that aims to recover sharp, high-frame-rate videos from blurry, low-frame-rate inputs captured under unknown and dynamic exposure conditions. Event cameras are sensors with high temporal resolution, making them especially advantageous for this task. However, existing event-guided methods struggle to produce satisfactory results on severely low-frame-rate blurry videos due to the lack of temporal constraints. In this paper, we introduce a novel event-guided framework for exposure-agnostic VFI, addressing this limitation through two key components: a Target-adaptive Event Sampling (TES) and a Target-adaptive Importance Mapping (TIM). Specifically, TES samples events around the target timestamp and the unknown exposure time to better align them with the corresponding blurry frames. TIM then generates an importance map that considers the temporal proximity and spatial relevance of consecutive features to the target. Guided by this map, our framework adaptively blends consecutive features, allowing temporally aligned features to serve as the primary cues while spatially relevant ones offer complementary support. Extensive experiments on both synthetic and real-world datasets demonstrate the effectiveness of our approach in exposure-agnostic VFI scenarios.

视频插帧事件相机自适应融合曝光无关

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。