用符号语言让AI学会智能室内布局设计
Learning an Interior Layout Policy in a Domain Specific Language Action Space

- 用领域专属语言表示布局动作,使设计决策可解释
- 在3D-FrontDSL数据集上训练,提升布局合理性和逻辑性
- 适合关注智能设计与可解释生成的研究者
室内场景布局生成是室内设计中的挑战性任务。现有方法常将房间条件简化为粗粒度的3D边界框,忽略门、窗等结构元素。更根本的问题在于,许多先前方法将空间推理建模为直接坐标预测,将布局设计视为对原始几何参数的连续回归,阻碍模型学习智能布局设计的内在逻辑。本文提出 extbf{LayoutDSL},一种基于大语言模型的新型框架,用于在领域专属语言(DSL)动作空间中学习室内布局策略。该DSL提供布局信息的显式符号表示,作为结构化动作空间支持布局推理,每个动作对应一个可解释的设计决策。在此DSL策略学习范式下,我们构建了3D-FrontDSL数据集,包含房间结构标注与合成的DSL动作序列,用于监督微调。为促进更具泛化性和可扩展性的策略并实现可验证反馈,我们设计了基于室内设计原则和物理合理性的奖励函数,并通过强化学习优化策略。大量实验表明,LayoutDSL在空间合理性与设计逻辑性方面显著优于强基线及现有方法。
原文摘要 · Abstract (English)
Indoor scene layout generation is a challenging task in interior design. Existing methods often oversimplify the task by reducing room conditions to coarse 3D bounding boxes and neglecting structural elements such as doors and windows. More fundamentally, many prior approaches formulate spatial reasoning as direct coordinate prediction, thereby casting interior layout design as continuous regression over raw geometric parameters, which hinders the model from learning the underlying reasoning logic of intelligent layout design. We propose \textbf{LayoutDSL}, a novel LLM-based framework for learning an interior layout policy in a domain-specific language (DSL) action space. The DSL provides an explicit symbolic representation of layout information and serves as a structured action space for layout reasoning, where each action corresponds to an interpretable design decision. Under this DSL-based policy learning paradigm, we construct 3D-FrontDSL, a dataset of room-structure annotations paired with synthetic DSL action sequences for supervised fine-tuning. To promote a more generalizable and scalable policy with verifiable feedback, we design rewards grounded in interior design principles and physical plausibility, and optimize the policy via reinforcement learning. Extensive experiments demonstrate that LayoutDSL substantially improves spatial plausibility and design logicality over strong baselines and existing methods.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。