arXiv:2511.16124cs.CV2025-11AAAI被引 2

提出新方法提升高分辨率视频插帧清晰度,解决模糊与伪影问题。

VTinker: Guided Flow Upsampling and Texture Mapping for High-Resolution Video Frame Interpolation

  • 用输入帧引导流场上采样,减少边缘模糊
  • 生成中间代理图并映射纹理块,避免像素级伪影
  • 适合追求高清视频插帧质量的研究者与开发者

由于大像素运动和高计算成本,高分辨率帧的运动估计极具挑战。现有基于光流的视频插帧(VFI)方法通常先在低分辨率下预测双向光流,再通过高倍上采样(如双线性)获得高分辨率光流,但该策略可能导致光流边缘模糊或马赛克。此外,低分辨率运动估计难以捕捉高分辨率细粒度像素运动,导致任务导向光流错位,进而使输入帧逐像素扭曲拼接,产生鬼影和不连续现象。本文提出新VFI框架VTinker,包含两个核心组件:引导式流场上采样(GFU)与纹理映射(Texture Mapping)。低分辨率运动估计后,GFU引入输入帧作为指导,缓解双线性上采样带来的细节模糊,使光流边缘更清晰。随后,纹理映射生成初始插值帧(即中间代理),该代理用于从输入帧中选择清晰纹理块,并映射至代理以辅助重建模块生成最终插值帧。大量实验表明,VTinker在多个基准数据集上达到当前最优性能。代码已开源:https://github.com/Wucy0519/VTinker。

原文摘要 · Abstract (English)

Due to large pixel movement and high computational cost, estimating the motion of high-resolution frames is challenging. Thus, most flow-based Video Frame Interpolation (VFI) methods first predict bidirectional flows at low resolution and then use high-magnification upsampling (e.g., bilinear) to obtain the high-resolution ones. However, this kind of upsampling strategy may cause blur or mosaic at the flows' edges. Additionally, the motion of fine pixels at high resolution cannot be adequately captured in motion estimation at low resolution, which leads to the misalignment of task-oriented flows. With such inaccurate flows, input frames are warped and combined pixel-by-pixel, resulting in ghosting and discontinuities in the interpolated frame. In this study, we propose a novel VFI pipeline, VTinker, which consists of two core components: guided flow upsampling (GFU) and Texture Mapping. After motion estimation at low resolution, GFU introduces input frames as guidance to alleviate the blurring details in bilinear upsampling flows, which makes flows' edges clearer. Subsequently, to avoid pixel-level ghosting and discontinuities, Texture Mapping generates an initial interpolated frame, referred to as the intermediate proxy. The proxy serves as a cue for selecting clear texture blocks from the input frames, which are then mapped onto the proxy to facilitate producing the final interpolated frame via a reconstruction module. Extensive experiments demonstrate that VTinker achieves state-of-the-art performance in VFI. Codes are available at: https://github.com/Wucy0519/VTinker.

视频插帧光流上采样纹理映射

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。