arXiv:2603.29664cs.CV2026-03被引 4

用AI自动剪辑数小时视频,让画面精准同步音乐节奏。

CutClaw: Agentic Hours-Long Video Editing via Music Synchronization

  • 多智能体系统协同,分层解析音视频内容。
  • 生成节奏对齐的短片,叙事连贯且视觉美观。
  • 适合短视频创作者快速产出高质量作品。

当前社交媒体中,通过音频对齐编辑视频已成为一种数字创作艺术。然而,手动剪辑耗时重复,长期困扰影视创作者与专业内容生产者。本文提出CutClaw,一个自主的多智能体框架,利用多个多模态大模型(MLLMs)作为智能体系统,将数小时原始素材自动剪辑为意义明确、音乐同步的短视频,具备清晰指令和视觉吸引力。具体而言,方法首先采用分层多模态分解,捕捉视觉与音频内容中的细粒度特征与全局结构;接着,由Playwriter智能体统筹叙事流程,将视觉场景锚定于音乐变化节点以确保故事连贯性;最后,编辑与评审智能体协作,基于严格美学与语义标准筛选细粒度画面,优化最终成片。实验表明,CutClaw在生成高质量、节奏对齐视频方面显著优于现有先进基线。代码已开源:https://github.com/GVCLab/CutClaw。

原文摘要 · Abstract (English)

Editing the video content with audio alignment forms a digital human-made art in current social media. However, the time-consuming and repetitive nature of manual video editing has long been a challenge for filmmakers and professional content creators alike. In this paper, we introduce CutClaw, an autonomous multi-agent framework designed to edit hours-long raw footage into meaningful short videos that leverages the capabilities of multiple Multimodal Language Models~(MLLMs) as an agent system. It produces videos with synchronized music, followed by instructions, and a visually appealing appearance. In detail, our approach begins by employing a hierarchical multimodal decomposition that captures both fine-grained details and global structures across visual and audio footage. Then, to ensure narrative consistency, a Playwriter Agent orchestrates the whole storytelling flow and structures the long-term narrative, anchoring visual scenes to musical shifts. Finally, to construct a short edited video, Editor and Reviewer Agents collaboratively optimize the final cut via selecting fine-grained visual content based on rigorous aesthetic and semantic criteria. We conduct detailed experiments to demonstrate that CutClaw significantly outperforms state-of-the-art baselines in generating high-quality, rhythm-aligned videos. The code is available at: https://github.com/GVCLab/CutClaw.

视频生成多智能体音乐同步

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。