用几何块生成可编辑的图像场景，支持移动物体和相机。
Generative Blocks World: Moving Things Around in Pictures
- 将场景抽象为3D凸体组合，支持整体或细节级编辑。
- 通过深度与纹理提示生成图像，保持物体身份与视觉一致性。
- 在图像质量、可编辑性和组合泛化上优于现有方法。
我们提出生成式积木世界（Generative Blocks World），通过操作简单的几何抽象来交互式修改生成图像中的场景。该方法将场景表示为凸3D基本体的组合，同一场景可用不同数量的基本体表示，使编辑者可操作整体结构或细微部分。场景几何编辑完成后，使用基于流的生成方法重建图像，条件输入包括深度图和纹理提示。该纹理提示考虑了修改后的3D基本体，超越了现有技术的纹理一致性。实验证明，该方法在视觉保真度、编辑灵活性和组合泛化能力上均优于先前工作。
原文摘要 · Abstract (English)
We describe Generative Blocks World to interact with the scene of a generated image by manipulating simple geometric abstractions. Our method represents scenes as assemblies of convex 3D primitives, and the same scene can be represented by different numbers of primitives, allowing an editor to move either whole structures or small details. Once the scene geometry has been edited, the image is generated by a flow-based method, which is conditioned on depth and a texture hint. Our texture hint takes into account the modified 3D primitives, exceeding the texture-consistency provided by existing techniques. These texture hints (a) allow accurate object and camera moves and (b) preserve the identity of objects. Our experiments demonstrate that our approach outperforms prior works in visual fidelity, editability, and compositional generalization.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品；中文卡片由大模型生成，请以原文为准。