提出高效生成游戏风格透明视频的新方法,提升画质与速度。
Alpha as an Efficiency Signal: Visibility-Routed RGBA Image-to-Video Generation

- 用可见性路由提前跳过透明区域计算,加速推理
- 联合生成RGB与透明通道,降低模糊与失真问题
- 专为游戏动画设计2.4K数据集,适配视觉特效开发
RGBA视频结合RGB外观与透明通道,使动画资源可在任意背景上应用,广泛用于游戏行业。但生成高质量游戏风格的RGBA动画仍面临两大挑战:现有数据集多为写实内容,缺乏游戏资产覆盖;传统先生成再抠像的流程在半透明区域易受背景干扰,导致抠像不稳定。近期虽有联合建模方法,但多依赖文本条件,效率与质量仍有不足。为此,我们构建了GameAlpha-2.4K数据集,采用友好抠像的合成方式、多假设透明恢复和基于合成的质量筛选机制。基于该数据集,训练了一个参考条件下的端到端RGBA视频生成模型,可单次完成RGB帧与透明图生成。为提升效率,提出可见性路由机制,在早期识别透明令牌并跳过其后续DiT更新,同时使用x_0-lock引导其沿原始流匹配路径至自预测终点。模型相比传统两阶段方法取得更低的FVD,且在最后两个DiT去噪步骤中跳过35%的令牌计算,实现1.2倍主干网络加速,质量损失可忽略。
原文摘要 · Abstract (English)
RGBA videos combine RGB appearance with an alpha channel, enabling animated assets to be applied across arbitrary backgrounds, which are heavily used in gaming industry. However, generating high-quality RGBA animations for games remains challenging for two reasons. First, most existing RGBA video datasets are dominated by photorealistic content, with limited coverage of game assets. Second, the traditional generate-then-matte pipelines estimate alpha only after RGB synthesis, so semi-transparent regions are often blurred by background, resulting in unstable matting outputs. More recently, many methods have begun to model RGB and alpha jointly, but existing approaches are mostly text-conditioned, and still have unresolved issues in efficiency and quality. To address these challenges, we introduce GameAlpha-2.4K, a 2.4K-clip game-style RGBA video dataset built with matte-friendly synthesis, multi-hypothesis alpha recovery, and compositing-based quality gates. Using this dataset, we train a reference-conditioned RGBA video generator that jointly produces RGB frames and alpha mattes in a single pass. To improve efficiency, we propose a visibility router that identifies transparent tokens in an early stage and bypasses their later DiT updates, while x_0-lock guides them along the original flow-matching schedule toward self-predicted endpoints. Our model obtains lower FVD than traditional two-stage pipelines, and the visibility router skips 35% of token evaluations in the final two DiT denoising steps, providing a 1.2x backbone speedup with negligible quality degradation compared to dense inference.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。