arXiv:2510.02034cs.CV2025-10被引 1

无需标注数据,实现高质量3D形状与纹理的无缝变形。

SemMorph3D: Unsupervised Semantic-Aware 3D Morphing via Mesh-Guided Gaussians

  • 用粗略网格引导无结构高斯点,保持几何连贯性。
  • 在新基准上颜色一致性误差降低22.2%,形态保真度提升26.2%。
  • 适合做3D内容生成、动画制作的开发者和研究人员。

我们提出一种新框架,直接从多视角图像实现语义感知的3D形状与纹理变形。尽管3D高斯泼溅(3DGS)可实现逼真渲染,但其无结构特性在变形时易导致几何破碎。传统基于网格的方法虽能保证结构完整,却需高质量输入拓扑,难以处理复杂外观。本文采用网格引导策略:通过提取的粗略基础网格作为柔性几何锚点,为无结构高斯提供拓扑支撑,有效缓解网格提取误差与拓扑限制。同时提出双域优化机制,融合测地线正则化以保形,结合纹理感知约束以确保颜色演化一致。该方法无需标注数据、专用3D资产或类别模板,即可实现稳定且物理合理的变形。在自建的TexMorph基准上,相比现有2D与3D方法显著提升性能,生成全纹理、拓扑鲁棒的3D变形结果,颜色一致性误差(Delta E)降低22.2%,影像相似性指数(EI)提升26.2%。

原文摘要 · Abstract (English)

We introduce METHODNAME, a novel framework for semantic-aware 3D shape and texture morphing directly from multi-view images. While 3D Gaussian Splatting (3DGS) enables photorealistic rendering, its unstructured nature often leads to catastrophic geometric fragmentation during morphing. Conversely, traditional mesh-based morphing enforces structural integrity but mandates pristine input topology and struggles with complex appearances. Our method resolves this dichotomy by employing a mesh-guided strategy where a coarse, extracted base mesh acts as a flexible geometric anchor. This anchor provides the necessary topological scaffolding to guide unstructured Gaussians, successfully compensating for mesh extraction artifacts and topological limitations. Furthermore, we propose a novel dual-domain optimization strategy that leverages this hybrid representation to establish unsupervised semantic correspondence, synergizing geodesic regularizations for shape preservation with texture-aware constraints for coherent color evolution. This integrated approach ensures stable, physically plausible transformations without requiring labeled data, specialized 3D assets, or category-specific templates. On the proposed TexMorph benchmark, METHODNAME substantially outperforms prior 2D and 3D methods, yielding fully textured, topologically robust 3D morphing while reducing color consistency error (Delta E) by 22.2% and EI by 26.2%. Project page: https://baiyunshu.github.io/GAUSSIANMORPHING.github.io/

3D变形高斯泼溅无监督纹理保持

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。