arXiv:2510.13652cs.CV2025-10被引 4

用单帧引导视频传播,实现高效3D编辑。

EditCast3D: Single-Frame-Guided 3D Editing with Video Propagation and View Selection

  • 通过视频生成模型将单帧编辑扩散到全数据集。
  • 在多个视图中选择一致且适合重建的视角,提升3D质量。
  • 无需反复优化,显著降低计算成本,适合大规模3D编辑。

近期基础模型推动了图像编辑的显著进展,但其向3D编辑的拓展仍不充分。直接将图像编辑模块替换为基础模型虽可行,但其高计算开销和闭源API限制使其难以融入现有迭代编辑流程。为此,我们提出EditCast3D,利用视频生成基础模型在重建前将单帧编辑传播至整个数据集。尽管编辑传播可实现数据级编辑,但在3D重建中多视角对齐要求下一致性不足。为此,EditCast3D引入视图选择策略,显式识别一致且利于重建的视图,并采用前馈重建,避免昂贵的精细化调整。该方法同时减少对高成本图像编辑的依赖,并缓解独立应用基础模型时的提示歧义问题。我们在常用3D编辑数据集上评估,结果优于现有最先进基线,在编辑质量与效率方面均表现优异。这证明EditCast3D是一种可扩展、通用的基础模型集成方案。代码已开源:https://github.com/UNITES-Lab/EditCast3D。

原文摘要 · Abstract (English)

Recent advances in foundation models have driven remarkable progress in image editing, yet their extension to 3D editing remains underexplored. A natural approach is to replace the image editing modules in existing workflows with foundation models. However, their heavy computational demands and the restrictions and costs of closed-source APIs make plugging these models into existing iterative editing strategies impractical. To address this limitation, we propose EditCast3D, a pipeline that employs video generation foundation models to propagate edits from a single first frame across the entire dataset prior to reconstruction. While editing propagation enables dataset-level editing via video models, its consistency remains suboptimal for 3D reconstruction, where multi-view alignment is essential. To overcome this, EditCast3D introduces a view selection strategy that explicitly identifies consistent and reconstruction-friendly views and adopts feedforward reconstruction without requiring costly refinement. In combination, the pipeline both minimizes reliance on expensive image editing and mitigates prompt ambiguities that arise when applying foundation models independently across images. We evaluate EditCast3D on commonly used 3D editing datasets and compare it against state-of-the-art 3D editing baselines, demonstrating superior editing quality and high efficiency. These results establish EditCast3D as a scalable and general paradigm for integrating foundation models into 3D editing pipelines. The code is available at https://github.com/UNITES-Lab/EditCast3D

3D编辑视频生成基础模型视图选择

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。