让AI像建筑师一样逐步画图,生成更合理且可落地的3D住宅布局。
PlanCraft: Sketch, Refine, and Furnish for Architect-Inspired Progressive 3D Residential Scene Generation
- 模仿建筑师从草图到精修的过程,分步生成布局
- 25%完成度的草图已超越全量输入的现有方法
- 适合建筑设计、智能家居等需要空间合理性场景
自动化住宅平面图生成中存在两个被忽视的关键问题:一是设计本质上是渐进式的,而现有方法要求条件信息完全指定后才开始生成,与真实设计流程不符;二是二维平面图不是可选中间步骤,而是不可替代的空间契约。一旦房间边界、门窗位置确定,家具布置就从开放的空间推理变为有约束的求解。跳过此契约(如用通用语言模型生成布局)会导致房间重叠、比例失真。为此,我们提出PlanCraft。SketchPlan通过回放8万张真实平面图的绘制过程,生成各完成度的局部草图作为训练信号。PlanCraft-Diff采用由粗到细策略,将不完整草图逐步细化为几何精确、可向量化表示的平面图。在空间契约确立后,PlanCraft-Agent在明确的房间边界内完成场景布置。实验表明,PlanCraft在FID上比最佳2D方法低61.1%,在专家评估的空间合理性上比现有3D系统高出15分,且仅需25%完成度的草图即可超越所有全量输入基线。
原文摘要 · Abstract (English)
Two structural insights have been overlooked in automated residential floor plan generation. First, design is inherently progressive. Architects begin with rough strokes and refine them over time, whereas existing methods typically require their conditioning representation to be fully specified before generation, a fundamental mismatch with how design actually works. Second, the 2D floor plan is not an optional intermediate but an irreplaceable spatial contract. Once room boundaries, doors, and windows are fixed, furnishing reduces from open-ended spatial reasoning to bounded constraint satisfaction. Bypassing this contract, as existing 3D systems do by delegating layout to language models, yields overlapping rooms and implausible proportions; directly calling general-purpose language models likewise produces geometrically invalid layouts. Guided by these insights, we present PlanCraft. SketchPlan supplies the missing training signal by replaying the architect's drawing process on 80K real floor plans, producing partial sketches at every completeness level. PlanCraft-Diff progressively sharpens an incomplete sketch into a geometrically precise, vectorizable floor plan through a coarse-to-fine strategy. With the spatial contract established, PlanCraft-Agent then furnishes the scene within well-defined room boundaries. Experiments show that PlanCraft achieves a 61.1\% lower FID than the best existing 2D method and surpasses existing 3D systems by 15 points in expert-rated spatial rationality, with a sketch at only 25\% completion already outperforming all fully specified baselines.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。