arXiv:2510.17519cs.CVcs.AI2025-10

MUG-V 10B 提出高效训练框架,让大模型生成视频更省力更快。

MUG-V 10B: High-efficiency Training Pipeline for Large Video Generation Models

  • 四方面优化:数据、架构、训练策略与基础设施
  • 100亿参数模型在电商视频生成上优于开源基线
  • 首次开源基于 Megatron-Core 的大规模视频训练代码

近年来,视觉内容(如图像、视频、3D 物体/场景)的大规模生成模型取得显著进展。然而,由于跨模态文本-视频对齐、长序列依赖以及复杂的时空关系,训练大规模视频生成模型仍面临巨大挑战。为此,我们提出一个优化四大核心环节的训练框架:(i) 数据处理,(ii) 模型架构,(iii) 训练策略,(iv) 基础设施。这些优化在数据预处理、视频压缩、参数扩展、基于课程的预训练及对齐导向的后训练等阶段均带来显著效率提升和性能改进。由此产生的模型 MUG-V 10B 在整体表现上达到当前最先进水平,尤其在电商场景视频生成任务中,人类评估结果优于主流开源基线。更重要的是,我们公开了完整技术栈,包括模型权重、基于 Megatron-Core 的大规模训练代码及视频生成与增强推理管道。据我们所知,这是首个利用 Megatron-Core 实现高训练效率和近线性多节点扩展的大规模视频生成训练代码开源项目,详情见 https://github.com/Shopee-MUG/MUG-V。

原文摘要 · Abstract (English)

In recent years, large-scale generative models for visual content (\textit{e.g.,} images, videos, and 3D objects/scenes) have made remarkable progress. However, training large-scale video generation models remains particularly challenging and resource-intensive due to cross-modal text-video alignment, the long sequences involved, and the complex spatiotemporal dependencies. To address these challenges, we present a training framework that optimizes four pillars: (i) data processing, (ii) model architecture, (iii) training strategy, and (iv) infrastructure for large-scale video generation models. These optimizations delivered significant efficiency gains and performance improvements across all stages of data preprocessing, video compression, parameter scaling, curriculum-based pretraining, and alignment-focused post-training. Our resulting model, MUG-V 10B, matches recent state-of-the-art video generators overall and, on e-commerce-oriented video generation tasks, surpasses leading open-source baselines in human evaluations. More importantly, we open-source the complete stack, including model weights, Megatron-Core-based large-scale training code, and inference pipelines for video generation and enhancement. To our knowledge, this is the first public release of large-scale video generation training code that exploits Megatron-Core to achieve high training efficiency and near-linear multi-node scaling, details are available in https://github.com/Shopee-MUG/MUG-V.

视频生成大模型训练Megatron-Core开源

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。