arXiv:2412.05180cs.CV2024-12

无需训练即可精准编辑视频色彩,操作简单且无时间伪影。

DreamColour: Controllable Video Colour Editing without Training

  • 通过关键帧点选+自动分割实现精确空间控制。
  • 双向色彩传播利用视频运动模式保持时序一致性。
  • 适合非专业用户快速制作高质量视频配色。

视频色彩编辑对内容创作至关重要,但现有方法要么需逐帧繁琐操作,要么产生不真实结果及时间伪影。本文提出一种无需训练的实用框架,通过直观界面实现精准视频色彩编辑,并保持专业级输出质量。核心思路是将空间与时间维度的色彩编辑解耦,使用户可先在关键帧中专注精确选色,再自动跨时间传播。技术上融合三点:(i) 点击即选界面,结合网格色彩选择与自动实例分割,实现精细空间控制;(ii) 双向色彩传播,利用视频内在运动模式进行稳定传递;(iii) 运动感知融合策略,确保复杂运动下过渡自然平滑。在多样化场景下的广泛评估表明,本方法性能达到或超越当前最优,且无需训练或专用硬件,使专业级视频调色惠及所有人。

原文摘要 · Abstract (English)

Video colour editing is a crucial task for content creation, yet existing solutions either require painstaking frame-by-frame manipulation or produce unrealistic results with temporal artefacts. We present a practical, training-free framework that makes precise video colour editing accessible through an intuitive interface while maintaining professional-quality output. Our key insight is that by decoupling spatial and temporal aspects of colour editing, we can better align with users' natural workflow -- allowing them to focus on precise colour selection in key frames before automatically propagating changes across time. We achieve this through a novel technical framework that combines: (i) a simple point-and-click interface merging grid-based colour selection with automatic instance segmentation for precise spatial control, (ii) bidirectional colour propagation that leverages inherent video motion patterns, and (iii) motion-aware blending that ensures smooth transitions even with complex object movements. Through extensive evaluation on diverse scenarios, we demonstrate that our approach matches or exceeds state-of-the-art methods while eliminating the need for training or specialized hardware, making professional-quality video colour editing accessible to everyone.

视频调色免训练交互设计

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。