arXiv:2511.22425cs.CV2025-11NeurIPS被引 5

无需训练即可实现高保真3D形态变换,支持纹理细节精准保留。

Wukong's 72 Transformations: High-fidelity Textured 3D Morphing via Flow Models

  • 基于流模型生成先验,无需手动配准和预处理。
  • 通过最优传输加权实现平滑几何过渡,避免形变突变。
  • 支持全局纹理变化与身份保持的纹理融合,适合创意设计应用。

我们提出WUKONG,一种无需训练的高保真带纹理3D形态变换框架,输入为一对源与目标提示(图像或文本)。不同于依赖人工对应匹配与形变轨迹估计的传统方法(限制泛化性且需高成本预处理),WUKONG利用流基变压器的生成先验,生成具有丰富纹理细节的高质量3D过渡。为确保形状过渡平滑,我们利用流模型生成过程的内在连续性,将形态变换建模为最优传输中值问题;进一步提出顺序初始化策略,防止几何突变并维持身份一致性。为保障纹理忠实还原,我们设计了一种相似性引导的语义一致性机制,选择性保留高频细节,并实现对混合动态的精确控制。该方法支持全局纹理转换与身份保持的纹理变形,满足多样化生成需求。大量定量与定性评估表明,WUKONG显著优于现有最先进方法,在多种几何与纹理变化场景下均取得更优表现。

原文摘要 · Abstract (English)

We present WUKONG, a novel training-free framework for high-fidelity textured 3D morphing that takes a pair of source and target prompts (image or text) as input. Unlike conventional methods -- which rely on manual correspondence matching and deformation trajectory estimation (limiting generalization and requiring costly preprocessing) -- WUKONG leverages the generative prior of flow-based transformers to produce high-fidelity 3D transitions with rich texture details. To ensure smooth shape transitions, we exploit the inherent continuity of flow-based generative processes and formulate morphing as an optimal transport barycenter problem. We further introduce a sequential initialization strategy to prevent abrupt geometric distortions and preserve identity coherence. For faithful texture preservation, we propose a similarity-guided semantic consistency mechanism that selectively retains high-frequency details and enables precise control over blending dynamics. This empowers WUKONG to support both global texture transitions and identity-preserving texture morphing, catering to diverse generation needs. Extensive quantitative and qualitative evaluations demonstrate that WUKONG significantly outperforms state-of-the-art methods, achieving superior results across diverse geometry and texture variations.

3D生成形态变换流模型纹理保留

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。