arXiv:2412.11100cs.CV2024-12CVPR被引 25

动态缩放技术实现任意尺寸全景视频生成,保持画面连贯性。

DynamicScaler: Seamless and Scalable Video Generation for Panoramic Scenes

  • 用可旋转窗口实现固定分辨率下的无缝全景去噪
  • 支持任意分辨率和宽高比,生成视频质量优于现有方法
  • 无需训练,适合虚拟现实场景动态内容创作

随着沉浸式AR/VR应用和空间智能需求增长,高质量全景视频生成成为关键。现有视频扩散模型受限于分辨率与长宽比,难以生成场景级动态内容。本文提出DynamicScaler,通过引入偏移滑动去噪器,在固定分辨率下实现空间可扩展的全景动态场景合成,利用无缝旋转窗口确保边界过渡自然、全局一致性。同时采用全局运动引导机制,兼顾局部细节与整体运动连续性。大量实验表明,该方法在全景场景级视频生成中表现优异,具有训练免、高效、可扩展优势,且显存消耗恒定,不随输出分辨率变化。项目主页:https://dynamic-scaler.pages.dev/new

原文摘要 · Abstract (English)

The increasing demand for immersive AR/VR applications and spatial intelligence has heightened the need to generate high-quality scene-level and 360$°$ panoramic video. However, most video diffusion models are constrained by limited resolution and aspect ratio, which restricts their applicability to scene-level dynamic content synthesis. In this work, we propose $\textbf{DynamicScaler}$, addressing these challenges by enabling spatially scalable and panoramic dynamic scene synthesis that preserves coherence across panoramic scenes of arbitrary size. Specifically, we introduce a Offset Shifting Denoiser, facilitating efficient, synchronous, and coherent denoising panoramic dynamic scenes via a diffusion model with fixed resolution through a seamless rotating Window, which ensures seamless boundary transitions and consistency across the entire panoramic space, accommodating varying resolutions and aspect ratios. Additionally, we employ a Global Motion Guidance mechanism to ensure both local detail fidelity and global motion continuity. Extensive experiments demonstrate our method achieves superior content and motion quality in panoramic scene-level video generation, offering a training-free, efficient, and scalable solution for immersive dynamic scene creation with constant VRAM consumption regardless of the output video resolution. Project page is available at $\href{https://dynamic-scaler.pages.dev/new}{https://dynamic-scaler.pages.dev/new}$.

全景视频扩散模型动态生成VR

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。