arXiv:2605.05079cs.CV2026-05

首个系统评估严重折射畸变下多帧图像修复的基准,覆盖从弱湍流到强不连续变形。

A unified Benchmark for Multi-Frame Image Restoration under Severe Refractive Warping

论文配图:A unified Benchmark for Multi-Frame Image Restoration under Severe Refractive Warping
图 1 · 摘自论文原文
  • 构建涵盖四类畸变等级的实验室实拍与物理建模合成数据
  • 在极端畸变下,扩散模型V-cache性能优于DATUM等先进方法
  • 首次融合像素级与感知级指标,全面评估几何修复效果

通过动态折射介质(如湍流空气或水面)拍摄视频序列时,常面临严重几何失真和时间不稳定问题。尽管近期研究解决了轻度大气湍流,但尚无基准能系统评估强且高度非均匀折射条件下的修复方法。本文提出一个全面的多帧图像修复基准,覆盖从类似湍流的轻度扭曲到强不连续折射变形的多种场景。基准包含实验室实拍真实数据及基于物理光折射建模生成的静态场景合成序列,涵盖四类畸变等级和多种表面波类型。我们评估了从简单基线到经典配准算法,再到先进学习方法(包括DATUM及本文提出的基于扩散的V-cache)在高和极端畸变下的表现。采用像素级(PSNR、SSIM)与感知级(LPIPS、DINO、CLIP)指标,实现首个大规模几何畸变去除分析。该基准为开发和评估高畸变光学环境下视频重建算法提供了新基础。代码与数据集已开源:https://github.com/iafoss/refractive-mfir-benchmark。

原文摘要 · Abstract (English)

Video sequence capturing through refractive dynamic media, such as a turbulent air or water surface, often suffer from severe geometric distortions and temporal instability. While recent advances address mild atmospheric turbulence, no existing benchmarks systematically evaluate restoration methods under strong and highly nonuniform refractive conditions. We present a comprehensive benchmark for geometric distortion removal in video, covering a range from turbulence-like mild warping to strong discontinuous refractive deformations. The benchmark includes both laboratory-captured real data and synthetic sequences generated for static scenes via physics-based light refraction modeling across four distortion levels and multiple surface wave types. We evaluate a spectrum of methods from simple baselines and classical registration algorithms to advanced learning-based approaches including DATUM and our proposed diffusion based V-cache for high and extreme distortions regimes. Evaluation uses both pixel-level (PSNR, SSIM), and perceptual (LPIPS, DINO, CLIP) metrics providing the first large scale analysis of geometric distortion removal. Our benchmark establishes a new foundation for developing and evaluating algorithms capable of reconstructing video from highly distorted optical environments. Our code and datasets are available at https://github.com/iafoss/refractive-mfir-benchmark.

图像修复视频重建折射畸变基准测试

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。