arXiv:2603.13312cs.MMcs.LG2026-03

让AI设计的房间既可建又好看,通过强化学习分离约束与审美。

Design-MLLM: A Reinforcement Alignment Framework for Verifiable and Aesthetic Interior Design

  • 用程序化检查确保布局可建造,先保可行性
  • 只在可行方案中比较美学,避免虚假美观
  • 群体相对优化获取稳定偏好信号,适合设计师参考

室内设计是将需求转化为可视化方案的过程,需同时满足可验证的空间可行性与相对美学偏好。尽管近期多模态大语言模型(MLLM)能统一理解用户意图并生成设计理由,但实证分析显示其部署中存在持续矛盾:生成的布局往往不可建且审美不一致。这表明仅添加领域内文本不足;有效设计需分离硬性约束与软性偏好,并在优化中协调二者。为此,我们提出Design-MLLM,一种基于强化学习的对齐框架,通过双分支、以美学为导向的奖励机制,优化可行性优先的偏好目标。具体而言,Design-MLLM (i) 使用程序化约束检查显式评估空间可行性,(ii) 仅在可行候选中评估美学偏好,避免产生看似美观但无法实现的捷径,(iii) 进行群体相对优化以获得稳定偏好信号。该过程使模型学习到可控策略,持续选择并生成既可执行又具美学一致性的方案,而非偶发生成视觉吸引但不可行的设计。在多个基准数据集上的大量实验验证了Design-MLLM的优势。

原文摘要 · Abstract (English)

Interior design is a requirements-to-visual-plan generation process that must simultaneously satisfy verifiable spatial feasibility and comparative aesthetic preferences. While recent multimodal large language models (MLLMs) offer a unified foundation for interpreting user intent and producing design rationales, our empirical analysis reveals a persistent contradiction in real-world deployment: MLLMs often produce layouts that are unbuildable and aesthetically inconsistent. These findings indicate that simply adding in-domain text is insufficient; effective interior design requires an alignment mechanism that separates hard constraints from soft preferences and coordinates them during optimization. To address this, we propose Design-MLLM, a reinforcement alignment framework that optimizes a feasibility-first preference objective via a dual-branch, aesthetic-oriented reward. Specifically, Design-MLLM (i) explicitly evaluates spatial feasibility using programmatic constraint checks, (ii) assesses aesthetic preference only among feasible candidates to avoid visually appealing but unexecutable shortcuts, and (iii) performs group-relative optimization to obtain stable preference signals. Through this process, Design-MLLM learns a controllable policy that consistently selects and generates solutions that are both executable and aesthetically coherent, rather than occasionally producing visually appealing but infeasible designs. Extensive experiments on various benchmark datasets demonstrate the advantages of Design-MLLM.

室内设计强化学习多模态可执行性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。