arXiv:2510.01361eess.IVcs.CV2025-10中稿 · manuscript, 7 page…

用运动场发散加权改进PSNR,更准更快评估视频插帧质量。

An Efficient Quality Metric for Video Frame Interpolation Based on Motion-Field Divergence

  • 在PSNR基础上引入运动场发散加权,突出时间不一致区域
  • 比FloLPIPS相关性高0.09,速度快2.5倍,内存少4倍
  • 适合用于训练插帧模型,兼顾精度与效率

视频插帧是提升视频时序质量的基础技术,但现有质量度量难以有效评估插值伪影的感知影响。传统指标如PSNR、SSIM和LPIPS忽略时间一致性;虽有针对插帧优化的先进指标如FloLPIPS,但存在计算效率低的问题。本文提出$ ext{PSNR}_{ ext{DIV}}$,一种基于运动场发散加权的全参考质量度量,该方法源自档案电影修复领域,用于检测时间不一致。通过识别运动场奇异点并加权图像误差,提升评估敏感度。在BVI-VFI数据集(180段视频,涵盖多种帧率、分辨率及插值方法)上的评估显示,$ ext{PSNR}_{ ext{DIV}}$相比FloLPIPS在皮尔逊相关系数上提升0.09,速度提升2.5倍,内存占用降低4倍。其性能在各类内容和不同运动估计器下均保持稳定。该度量兼具高效与准确,适用于快速质量评估及作为神经网络训练损失函数。代码已开源:www.github.com/conalld/psnr-div。

原文摘要 · Abstract (English)

Video frame interpolation is a fundamental tool for temporal video enhancement, but existing quality metrics struggle to evaluate the perceptual impact of interpolation artefacts effectively. Metrics like PSNR, SSIM and LPIPS ignore temporal coherence. State-of-the-art quality metrics tailored towards video frame interpolation, like FloLPIPS, have been developed but suffer from computational inefficiency that limits their practical application. We present $\text{PSNR}_{\text{DIV}}$, a novel full-reference quality metric that enhances PSNR through motion divergence weighting, a technique adapted from archival film restoration where it was developed to detect temporal inconsistencies. Our approach highlights singularities in motion fields which is then used to weight image errors. Evaluation on the BVI-VFI dataset (180 sequences across multiple frame rates, resolutions and interpolation methods) shows $\text{PSNR}_{\text{DIV}}$ achieves statistically significant improvements: +0.09 Pearson Linear Correlation Coefficient over FloLPIPS, while being 2.5$\times$ faster and using 4$\times$ less memory. Performance remains consistent across all content categories and are robust to the motion estimator used. The efficiency and accuracy of $\text{PSNR}_{\text{DIV}}$ enables fast quality evaluation and practical use as a loss function for training neural networks for video frame interpolation tasks. An implementation of our metric is available at www.github.com/conalld/psnr-div.

视频插帧质量度量运动场效率优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。