提出显式-隐式协同的3D重建方法,实现精细可控的物体编辑。
CEI-3D: Collaborative Explicit-Implicit 3D Reconstruction for Realistic and Fine-Grained Object Editing
- 用隐式SDF与可调点协同表示物体,兼顾全局平滑与局部控制。
- 分离处理颜色属性,避免编辑时干扰非目标区域。
- 支持按部件编辑物理属性,提升真实感和操作效率。
现有3D编辑方法因重建网络深度耦合,常产生不真实、粗糙的结果。本文提出面向编辑的重建框架CEI-3D,采用显式-隐式协同重建策略:以隐式SDF网络提供连续几何先验,结合差异化采样的可调控点集实现局部操控。二者相互引导,增强结构一致性。为独立控制点属性,设计物理属性解耦模块,将颜色分解为独立物理属性;引入双分支漫反射-反照率网络,分别处理已编辑与未编辑区域,防止干扰。基于解耦的协同表示,进一步构建空间感知编辑模块,通过跨视图传播的3D分割策略,实现对目标部件物理属性的逐部分调节。在真实与合成数据集上的实验表明,该方法在保持更真实、更精细编辑效果的同时,显著减少编辑时间,优于当前最先进方法。代码已开源。
原文摘要 · Abstract (English)
Existing 3D editing methods often produce unrealistic and unrefined results due to the deeply integrated nature of their reconstruction networks. To address the challenge, this paper introduces CEI-3D, an editing-oriented reconstruction pipeline designed to facilitate realistic and fine-grained editing. Specifically, we propose a collaborative explicit-implicit reconstruction approach, which represents the target object using an implicit SDF network and a differentially sampled, locally controllable set of handler points. The implicit network provides a smooth and continuous geometry prior, while the explicit handler points offer localized control, enabling mutual guidance between the global 3D structure and user-specified local editing regions. To independently control each attribute of the handler points, we design a physical properties disentangling module to decouple the color of the handler points into separate physical properties. We also propose a dual-diffuse-albedo network in this module to process the edited and non-edited regions through separate branches, thereby preventing undesired interference from editing operations. Building on the reconstructed collaborative explicit-implicit representation with disentangled properties, we introduce a spatial-aware editing module that enables part-wise adjustment of relevant handler points. This module employs a cross-view propagation-based 3D segmentation strategy, which helps users to edit the specified physical attributes of a target part efficiently. Extensive experiments on both real and synthetic datasets demonstrate that our approach achieves more realistic and fine-grained editing results than the state-of-the-art (SOTA) methods while requiring less editing time. Our code is available on https://github.com/shiyue001/CEI-3D.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。