arXiv:2503.11044cs.CV2025-03被引 1

通过渐进采样实现4D场景编辑的视角与时间一致性

PSF-4D: A Progressive Sampling Framework for View Consistent 4D Editing

  • 在扩散过程中控制噪声初始化,实现时序与多视角一致
  • 跨视图共享噪声提升空间一致性,支持高质量多角度编辑
  • 无需外部模型,适合内容创作与影视特效领域

基于文本的生成模型近年来推动了内容编辑的发展。为将此类能力扩展至4D场景,我们提出一种渐进采样框架PSF-4D,通过在前向扩散过程中直观控制噪声初始化,确保时间与多视角一致性。为实现时序连贯性,设计关联高斯噪声结构,使各帧间存在有意义依赖;为保证跨视角空间一致性,引入跨视图噪声模型,融合共享与独立噪声成分以平衡共性与细节差异。进一步通过视图一致的迭代优化,在去噪过程中嵌入视图感知信息,确保跨帧与跨视角编辑对齐。该方法无需依赖外部模型,已在多个基准测试中验证有效性,涵盖风格迁移、多属性编辑、物体移除与局部编辑等任务,实验结果表明其优于现有最先进4D编辑方法。

原文摘要 · Abstract (English)

Instruction-guided generative models, especially those using text-to-image (T2I) and text-to-video (T2V) diffusion frameworks, have advanced the field of content editing in recent years. To extend these capabilities to 4D scene, we introduce a progressive sampling framework for 4D editing (PSF-4D) that ensures temporal and multi-view consistency by intuitively controlling the noise initialization during forward diffusion. For temporal coherence, we design a correlated Gaussian noise structure that links frames over time, allowing each frame to depend meaningfully on prior frames. Additionally, to ensure spatial consistency across views, we implement a cross-view noise model, which uses shared and independent noise components to balance commonalities and distinct details among different views. To further enhance spatial coherence, PSF-4D incorporates view-consistent iterative refinement, embedding view-aware information into the denoising process to ensure aligned edits across frames and views. Our approach enables high-quality 4D editing without relying on external models, addressing key challenges in previous methods. Through extensive evaluation on multiple benchmarks and multiple editing aspects (e.g., style transfer, multi-attribute editing, object removal, local editing, etc.), we show the effectiveness of our proposed method. Experimental results demonstrate that our proposed method outperforms state-of-the-art 4D editing methods in diverse benchmarks.

4D编辑扩散模型多视角生成

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。