多智能体协作修正文本提示,提升复杂场景视频生成质量
SCMAPR: Self-Correcting Multi-Agent Prompt Refinement for Complex-Scenario Text-to-Video Generation

- 设计多智能体系统分阶段优化模糊文本提示
- 在多个基准上实现最高3.28%的生成质量提升
- 适合需要精准控制复杂视频生成的研究者
文本到视频(T2V)生成得益于扩散模型的发展,但现有系统在复杂场景下仍表现不佳,主要因文本提示存在歧义和信息不足。本文将复杂场景提示优化建模为分阶段多智能体协同过程,提出SCMAPR框架——一种情境感知且具备自我修正能力的多智能体提示优化方法。该框架通过专用智能体实现:(i) 将提示路由至基于分类体系的情境以选择策略;(ii) 生成情境感知的重写规则并执行条件化优化;(iii) 进行结构化语义验证,检测违规时触发有条件修正。为明确定义复杂场景、提供典型示例并支持严格评估,我们引入T2V-Complexity,一个仅包含复杂场景提示的T2V评测基准。在3个现有基准及T2V-Complexity上的大量实验表明,SCMAPR在复杂场景下持续提升文本-视频对齐度与生成质量,相较3个先进基线,在VBench和EvalCrafter上平均得分最高提升2.67%和3.28%,在T2V-CompBench上最高提升0.028。代码已开源。
原文摘要 · Abstract (English)
Text-to-Video (T2V) generation has benefited from recent advances in diffusion models, yet current systems still struggle under complex scenarios, which are generally exacerbated by the ambiguity and underspecification of text prompts. In this work, we formulate complex-scenario prompt refinement as a stage-wise multi-agent refinement process and propose SCMAPR, i.e., a scenario-aware and Self-Correcting Multi-Agent Prompt Refinement framework for T2V prompting. SCMAPR coordinates specialized agents to (i) route each prompt to a taxonomy-grounded scenario for strategy selection, (ii) synthesize scenario-aware rewriting policies and perform policy-conditioned refinement, and (iii) conduct structured semantic verification that triggers conditional revision when violations are detected. To clarify what constitutes complex scenarios in T2V prompting, provide representative examples, and enable rigorous evaluation under such challenging conditions, we further introduce T2V-Complexity, which is a complex-scenario T2V benchmark consisting exclusively of complex-scenario prompts. Extensive experiments on 3 existing benchmarks and our T2V-Complexity benchmark demonstrate that SCMAPR consistently improves text-video alignment and overall generation quality under complex scenarios, achieving up to 2.67% and 3.28 gains in average score on VBench and EvalCrafter, and up to 0.028 improvement on T2V-CompBench over 3 State-Of-The-Art baselines. The codes of SCMAPR are publicly available at https://github.com/HiThink-Research/SCMAPR.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。