arXiv:2510.00578cs.CV2025-10被引 3

任意帧率视频插值,可灵活生成任意数量中间帧。

Arbitrary Generative Video Interpolation

  • 用时间感知位置编码实现任意时间戳插值。
  • 支持2倍到32倍任意帧率插值,效果更自然连续。
  • 适合需要动态调整视频帧率的应用场景。

视频帧插值(VFI)从起始和结束帧生成中间帧,已成为视频生成的关键功能。然而,现有生成式VFI方法仅能生成固定数量的中间帧,难以灵活调整帧率或序列长度。本文提出ArbInterp,一种新型生成式VFI框架,支持任意时间戳和任意长度的插值。为实现任意时间戳插值,提出时间感知旋转位置编码(TaRoPE),通过调节时序RoPE中的位置,使生成帧对齐目标归一化时间戳,从而实现精细的时间控制。针对任意长度插值,将长序列生成分解为分段帧合成,并设计外观-运动解耦的条件策略:利用前一段端点保持外观一致性,借助时间语义保证运动连贯性,确保跨段时空过渡无缝。实验构建了涵盖多尺度插值(2x至32x)的全面基准,结果表明ArbInterp在所有场景下均优于现有方法,具有更高保真度与更流畅的时空连续性。

原文摘要 · Abstract (English)

Video frame interpolation (VFI), which generates intermediate frames from given start and end frames, has become a fundamental function in video generation applications. However, existing generative VFI methods are constrained to synthesize a fixed number of intermediate frames, lacking the flexibility to adjust generated frame rates or total sequence duration. In this work, we present ArbInterp, a novel generative VFI framework that enables efficient interpolation at any timestamp and of any length. Specifically, to support interpolation at any timestamp, we propose the Timestamp-aware Rotary Position Embedding (TaRoPE), which modulates positions in temporal RoPE to align generated frames with target normalized timestamps. This design enables fine-grained control over frame timestamps, addressing the inflexibility of fixed-position paradigms in prior work. For any-length interpolation, we decompose long-sequence generation into segment-wise frame synthesis. We further design a novel appearance-motion decoupled conditioning strategy: it leverages prior segment endpoints to enforce appearance consistency and temporal semantics to maintain motion coherence, ensuring seamless spatiotemporal transitions across segments. Experimentally, we build comprehensive benchmarks for multi-scale frame interpolation (2x to 32x) to assess generalizability across arbitrary interpolation factors. Results show that ArbInterp outperforms prior methods across all scenarios with higher fidelity and more seamless spatiotemporal continuity. Project website: https://mcg-nju.github.io/ArbInterp-Web/.

视频插值生成模型任意帧率

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。