arXiv:2608.17559cs.CV2026-08被引 1

解决多镜头视频编辑中身份漂移问题,实现跨镜头视觉一致。

MSEditor: Toward Consistent Multi-Shot Video Editing

论文配图:MSEditor: Toward Consistent Multi-Shot Video Editing
图 1 · 摘自论文原文
  • 用跨镜头监督信号训练扩散模型,保持主体外观一致。
  • 在自注意力机制中动态聚合相关镜头信息,减少累积误差。
  • 适合需要长时序一致性的视频编辑任务,如影视剪辑。

本文针对多镜头视频序列的统一、一致编辑问题展开研究。由于多镜头视频包含视角、相机尺度和主体姿态差异显著的不连续时间片段,易导致严重身份漂移与累积误差传播。实现连贯编辑需建立可靠的跨镜头语义感知能力,以维持主体外观稳定与视觉连续性。为此,我们提出首个专为多镜头视频一致编辑设计的MSEditor框架。为缓解高质量多镜头训练数据稀缺问题,我们复用现有多视角视频数据集提供鲁棒的跨镜头监督信号。架构上,引入监督适配器(Supervisory Adapter)将跨镜头信息注入扩散主干网络,使模型学习身份一致表征。同时,设计跨镜头打包策略(Cross-Shot Packing),在自注意力窗口内动态聚合语义相关镜头的信息,有效缓解累积误差并保障长时序一致性。大量实验表明,MSEditor在自建多镜头视频编辑基准上显著优于现有方法,在身份保持、时间稳定性与整体视觉质量方面均表现优异。

原文摘要 · Abstract (English)

In this paper, we tackle the problem of performing consistent, unified modifications to a multi-shot video sequence. This task is particularly challenging because multi-shot videos consist of discontinuous temporal segments that vary significantly in viewpoint, camera scale, and subject pose, leading to severe identity drift and cumulative error propagation. Achieving coherent edits requires establishing reliable cross-shot semantic awareness to maintain stable subject appearance and visual continuity across these disjointed boundaries. To address this, we propose MSEditor, the first framework designed specifically for consistent multi-shot video editing. To overcome the scarcity of high-quality multi-shot training data, we repurpose existing multi-view video datasets to provide robust cross-shot supervision. Architecturally, we introduce a Supervisory Adapter that injects this cross-shot information into the diffusion backbone, enabling the model to learn identity-consistent representations. Furthermore, to effectively mitigate cumulative errors and ensure long-range temporal coherence, we design a Cross-Shot Packing strategy that dynamically aggregates information from semantically related shots within the self-attention window. Extensive experiments demonstrate that MSEditor significantly outperforms existing methods on our curated multi-shot video editing benchmark in terms of identity preservation, temporal stability, and overall visual quality.

视频编辑扩散模型一致性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。