用文本指导局部编辑3D点云,保持整体结构一致。
Blended Point Cloud Diffusion for Localized Text-guided Shape Editing
- 基于扩散模型的点云修复框架,结合局部条件形状进行编辑。
- 在多噪声层级上融合原图与编辑结果,提升细节还原度。
- 无需复杂反演,适合需要精细调整的3D内容创作场景。
自然语言为3D形状的局部细粒度编辑提供了直观接口,但现有方法难以在局部修改时保持全局一致性。本文提出一种基于图像修复思想的点云编辑框架,利用3D扩散模型实现局部编辑,并引入部分条件形状作为结构引导,确保非编辑区域正确保留原始身份。为进一步增强编辑区域的身份一致性,我们设计了一种推理阶段的坐标混合算法,在噪声逐步增加的过程中平衡完整形状重建与局部修复。该方法无缝融合原始形状与编辑结果,避免了计算成本高且易出错的反演过程。大量实验表明,本方法在评估形状保真度和文本描述符合度的多项指标上均优于现有技术。
原文摘要 · Abstract (English)
Natural language offers a highly intuitive interface for enabling localized fine-grained edits of 3D shapes. However, prior works face challenges in preserving global coherence while locally modifying the input 3D shape. In this work, we introduce an inpainting-based framework for editing shapes represented as point clouds. Our approach leverages foundation 3D diffusion models for achieving localized shape edits, adding structural guidance in the form of a partial conditional shape, ensuring that other regions correctly preserve the shape's identity. Furthermore, to encourage identity preservation also within the local edited region, we propose an inference-time coordinate blending algorithm which balances reconstruction of the full shape with inpainting at a progression of noise levels during the inference process. Our coordinate blending algorithm seamlessly blends the original shape with its edited version, enabling a fine-grained editing of 3D shapes, all while circumventing the need for computationally expensive and often inaccurate inversion. Extensive experiments show that our method outperforms alternative techniques across a wide range of metrics that evaluate both fidelity to the original shape and also adherence to the textual description.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。