arXiv:2502.01719cs.CV2025-02被引 13

为视频生成设计细粒度评价体系与奖励模型,提升对齐与安全性。

MJ-VIDEO: Fine-Grained Benchmarking and Rewarding Video Preferences in Video Generation

  • 基于专家混合架构动态选择判断维度,实现精准奖励。
  • 在五个维度上提升17.58%整体评分与15.87%细粒度判断性能。
  • 适合研究视频生成对齐、安全与偏见问题的开发者与评测者。

视频生成技术虽取得显著进展,但仍面临指令错位、内容幻觉、安全与偏见等挑战。为此,我们构建了大规模视频偏好评估基准 MJ-BENCH-VIDEO,涵盖对齐、安全、精细度、连贯性与一致性、偏见与公平性五大方面,包含28项细粒度评估标准。基于此数据集,提出 MJ-VIDEO,一种基于混合专家(MoE)架构的视频奖励模型,可动态选择相关专家,依据文本-视频对进行精准偏好判断。该结构支持更精确且灵活的评估。在 MJ-BENCH-VIDEO 上的广泛测试表明,相比现有模型,MJ-VIDEO 在整体与细粒度偏好判断上分别提升17.58%与15.87%。此外,使用 MJ-VIDEO 进行偏好调优可显著增强视频生成的对齐表现。代码、数据与模型均开源于 https://aiming-lab.github.io/MJ-VIDEO.github.io/。

原文摘要 · Abstract (English)

Recent advancements in video generation have significantly improved the ability to synthesize videos from text instructions. However, existing models still struggle with key challenges such as instruction misalignment, content hallucination, safety concerns, and bias. Addressing these limitations, we introduce MJ-BENCH-VIDEO, a large-scale video preference benchmark designed to evaluate video generation across five critical aspects: Alignment, Safety, Fineness, Coherence & Consistency, and Bias & Fairness. This benchmark incorporates 28 fine-grained criteria to provide a comprehensive evaluation of video preference. Building upon this dataset, we propose MJ-VIDEO, a Mixture-of-Experts (MoE)-based video reward model designed to deliver fine-grained reward. MJ-VIDEO can dynamically select relevant experts to accurately judge the preference based on the input text-video pair. This architecture enables more precise and adaptable preference judgments. Through extensive benchmarking on MJ-BENCH-VIDEO, we analyze the limitations of existing video reward models and demonstrate the superior performance of MJ-VIDEO in video preference assessment, achieving 17.58% and 15.87% improvements in overall and fine-grained preference judgments, respectively. Additionally, introducing MJ-VIDEO for preference tuning in video generation enhances the alignment performance. All our code, data, and models are available at https://aiming-lab.github.io/MJ-VIDEO.github.io/.

视频生成奖励模型细粒度评估对齐优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。