arXiv:2502.14316cs.CVcs.AI2025-02ICCV被引 8

无需点对应,用3D扩散模型实现带纹理的3D物体平滑变形。

Textured 3D Regenerative Morphing with 3D Diffusion Prior

  • 用3D扩散先验在噪声、参数、条件三层面插值,生成变形序列。
  • 跨类别物体变形光滑自然,纹理与形状同步变化,优于现有方法。
  • 适合影视特效、创意设计,无需人工标注对应点。

纹理化3D形态变换可在两个3D物体间生成平滑且合理的过渡序列,同时兼顾形状与纹理变化,对电影视觉特效等创意应用至关重要。以往方法依赖点对点对应关系和光滑形变轨迹,限制于无纹理、拓扑一致的数据集,需繁琐预处理且泛化能力差。为此,我们提出基于3D扩散先验的3D再生形态变换方法。不同于依赖显式对应与形变的传统方法,本方法无需获取对应关系,直接利用3D扩散模型生成变形过程。具体地,我们在初始噪声、模型参数和条件特征三个层次进行源与目标信息插值,并引入注意力融合策略提升序列平滑性。为进一步增强语义插值合理性与生成表面质量,提出两项策略:(a) Token Reordering——基于语义分析匹配近似令牌以引导扩散去噪过程中的隐式对应;(b) Low-Frequency Enhancement——增强令牌中的低频信号,提升生成表面质量。实验表明,该方法在多样化的跨类别物体对上实现了更优的平滑性与合理性,为带纹理的3D形态变换提供了新颖的再生范式。

原文摘要 · Abstract (English)

Textured 3D morphing creates smooth and plausible interpolation sequences between two 3D objects, focusing on transitions in both shape and texture. This is important for creative applications like visual effects in filmmaking. Previous methods rely on establishing point-to-point correspondences and determining smooth deformation trajectories, which inherently restrict them to shape-only morphing on untextured, topologically aligned datasets. This restriction leads to labor-intensive preprocessing and poor generalization. To overcome these challenges, we propose a method for 3D regenerative morphing using a 3D diffusion prior. Unlike previous methods that depend on explicit correspondences and deformations, our method eliminates the additional need for obtaining correspondence and uses the 3D diffusion prior to generate morphing. Specifically, we introduce a 3D diffusion model and interpolate the source and target information at three levels: initial noise, model parameters, and condition features. We then explore an Attention Fusion strategy to generate more smooth morphing sequences. To further improve the plausibility of semantic interpolation and the generated 3D surfaces, we propose two strategies: (a) Token Reordering, where we match approximate tokens based on semantic analysis to guide implicit correspondences in the denoising process of the diffusion model, and (b) Low-Frequency Enhancement, where we enhance low-frequency signals in the tokens to improve the quality of generated surfaces. Experimental results show that our method achieves superior smoothness and plausibility in 3D morphing across diverse cross-category object pairs, offering a novel regenerative method for 3D morphing with textured representations.

3D生成扩散模型纹理重建形态变换

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。