arXiv:2510.13084cs.CV2025-10被引 1

轻量视频编辑方法,用相似特征传播提升效率与画质。

Edit-Your-Interest: Efficient Video Editing via Feature Most-Similar Propagation

  • 用时空特征缓存减少计算开销,避免全序列建模。
  • 通过最相似特征传播保持时序一致性,减少模糊和马赛克伪影。
  • 零样本文本驱动,适合需要精准对象编辑的用户。

文本到图像扩散模型在视频编辑中取得显著进展,但现有方法受限于高计算开销和内存消耗,且常牺牲视觉保真度,导致时间不一致及模糊、明显马赛克等伪影。本文提出 Edit-Your-Interest,一种轻量级、文本驱动、零样本视频编辑方法。引入时空特征记忆库(SFM),高效缓存空间注意力处理的关键图像标记;提出特征最相似传播(FMP)方法,将前一帧最相关标记传播至后续帧,保持时序一致性;设计SFM更新算法,持续刷新缓存特征,确保长视频序列中的长期有效性。同时利用交叉注意力图自动提取关注目标掩码,并无缝融入扩散去噪过程,实现对目标物体的细粒度控制,有效保留背景完整性。大量实验表明,该方法在效率与视觉保真度上均优于当前最优方法,验证了其优越性与实用性。

原文摘要 · Abstract (English)

Text-to-image (T2I) diffusion models have recently demonstrated significant progress in video editing. However, existing video editing methods are severely limited by their high computational overhead and memory consumption. Furthermore, these approaches often sacrifice visual fidelity, leading to undesirable temporal inconsistencies and artifacts such as blurring and pronounced mosaic-like patterns. We propose Edit-Your-Interest, a lightweight, text-driven, zero-shot video editing method. Edit-Your-Interest introduces a spatio-temporal feature memory to cache features from previous frames, significantly reducing computational overhead compared to full-sequence spatio-temporal modeling approaches. Specifically, we first introduce a Spatio-Temporal Feature Memory bank (SFM), which is designed to efficiently cache and retain the crucial image tokens processed by spatial attention. Second, we propose the Feature Most-Similar Propagation (FMP) method. FMP propagates the most relevant tokens from previous frames to subsequent ones, preserving temporal consistency. Finally, we introduce an SFM update algorithm that continuously refreshes the cached features, ensuring their long-term relevance and effectiveness throughout the video sequence. Furthermore, we leverage cross-attention maps to automatically extract masks for the instances of interest. These masks are seamlessly integrated into the diffusion denoising process, enabling fine-grained control over target objects and allowing Edit-Your-Interest to perform highly accurate edits while robustly preserving the background integrity. Extensive experiments decisively demonstrate that the proposed Edit-Your-Interest outperforms state-of-the-art methods in both efficiency and visual fidelity, validating its superior effectiveness and practicality.

视频编辑扩散模型轻量化时序一致性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。