让3D生成模型精准控制物体占据或避开特定空间区域。
Arbor: Explicit Geometric Conditioning for Controllable 3D Asset Generation

- 用约束网格定义物体应占、应避、应接触的三维区域
- 在不损失生成质量的前提下,约束遵守率显著提升
- 适合需要精确空间布局的工业设计与游戏资产创作
文本和图像驱动的3D模型虽能生成逼真资产,但难以直接控制物体所占空间或回避区域。在创作中,这类空间意图通常在生成前已知:椅子需适配坐姿空间,道具需留出运动间隙,零件需暴露接触面。提示词和图像视图无法有效传递此类约束,亟需显式控制接口。我们提出Arbor,一种可训练的文本条件隐空间3D生成附加模块。Arbor引入约束网格作为原生3D控制界面,包含几何存在区(hull)、避让区(avoidance)和接触区(touch)。这些网格非目标证据,而是局部类型化要求,可包含无表面区域。Arbor通过将约束网格转为令牌,并在冻结去噪器内学习路由连接,保持信号以几何形式存在。每个潜在区域仅接收与其空间位置相关的约束部分。我们在自动与人工标注的控制基准上评估了包含hull、avoidance、touch约束的性能,对比指标趋势与用户偏好研究结果。即使无专用合规损失,Arbor仍显著提升约束遵守度,同时保持固定约束下物体质量与多样性。
原文摘要 · Abstract (English)
Text and image conditioned 3D models now generate convincing assets, but they still offer little direct control over the space an object should occupy or avoid. In authoring, this spatial intent is often known before generation starts. A chair should fit a seating envelope, a prop should leave clearance for motion, or a part should expose a contact surface. Prompts and image views are poor carriers for such constraints, requiring the need for an explicit control interface. We present Arbor, a trainable attachment for text conditioned latent 3D generation. Arbor introduces constraint meshes as a native 3D control interface. The interface uses hull regions where geometry should exist, avoidance regions that should remain empty, and touch regions the object should contact. Unlike completion or whole object scaffold control, these meshes are not target evidence. They are local typed requirements and can include regions where no surface should appear. Arbor keeps this signal as geometry by converting constraint meshes into tokens and learning a routed attachment inside a frozen denoiser. Each latent region can therefore receive the part of the constraint that matters for its spatial location. We evaluate Arbor on automatic and artist curated control benchmarks with hull, avoidance, and touch constraints, and compare the metric trends to a user preference study. Even without dedicated compliance losses, Arbor improves constraint obedience while preserving object quality and variation under fixed constraints.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。