无需训练,精准编辑3D模型局部区域且保持整体结构一致
EditFlow3D: Automated Local Editing of 3D Assets with Trajectory Preservation

- 用视觉大模型自动生成编辑掩码和引导图,实现精准定位
- 通过轨迹保真机制,在不替换中间特征情况下保持非目标区一致性
- 新评测基准涵盖多种编辑类型,适合需要高质量局部修改的用户
可控的3D资产局部编辑需精准定位与有效视觉引导。现有方法缺乏简单准确的3D掩码获取方式,难以在保持非目标区域结构与外观的同时完成理想编辑。为此,我们提出EditFlow3D,一种无需训练的3D局部编辑框架。给定源资产与编辑指令,基于视觉语言模型(VLM)的工作流可解析编辑意图,自动生成视觉引导图与优化后的3D编辑掩码,实现在预训练3D生成模型原生表示空间中的局部编辑。具体地,掩码引导的差异流聚焦于目标区域,而分步轨迹保真机制确保非目标区域与源资产间的一致性,避免直接替换中间特征。由于现有Edit3D-Bench覆盖的局部编辑类别有限,我们进一步引入EditFlow-Bench作为补充基准,涵盖更广泛的结构性与外观编辑类型,并在两个基准上评估EditFlow3D。定量结果、定性对比与用户研究均表明,EditFlow3D在目标区域编辑精度和非目标区域保真度方面优于现有方法。
原文摘要 · Abstract (English)
Controllable local editing of 3D assets requires precise target localization and appropriate visual guidance. However, existing methods lack a simple yet accurate way to obtain 3D masks and struggle to achieve the desired edit while faithfully preserving the structure and appearance of non-target regions. To address these challenges, we present EditFlow3D, a training-free framework for local 3D editing. Given a source asset and an edit instruction, a VLM-driven workflow interprets the editing intent and automatically constructs a visual guidance image and a refined 3D editing mask, enabling localized editing in the native representation space of a pretrained 3D generative model. Specifically, mask-guided differential flow focuses the edit on the target region, while step-wise trajectory preservation maintains consistency between non-target regions and the source asset without directly replacing intermediate features. Since the existing Edit3D-Bench covers only a limited range of local editing categories, we further introduce EditFlow-Bench as a complementary benchmark encompassing a broader variety of structural and appearance edits, and evaluate EditFlow3D on both benchmarks. Quantitative results, qualitative comparisons, and a user study demonstrate that EditFlow3D achieves more accurate target-region editing and better preserves non-target regions than existing 3D editing methods.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。