用大模型生成室内设计布局,结构化推理更可靠
FlairGPT: Repurposing LLMs for Interior Designs
- 让大模型分步输出物品清单与摆放约束
- 将约束转为图结构,用优化算法生成最终布局
- 比现有方法更灵活,适合大规模虚拟场景生成
室内设计需精心挑选并布置物品,以创造美观、实用且风格统一的空间,同时符合客户需求。该任务挑战性强,因优秀设计不仅需包含所有必要物品且风格一致,还需确保布局合理、便于使用,并满足预算与使用需求等多重约束。现有数据驱动方案多局限于特定房间或领域,且缺乏设计决策的可解释性。本文探究大语言模型(LLMs)在室内设计中的直接应用。尽管当前LLMs尚无法独立生成完整布局,但通过模仿设计师的工作流程,系统性地调用它们,可稳定生成物品列表及关键摆放约束。我们将这些信息转化为设计布局图,再利用现成的约束优化工具求解,生成最终布局。我们在多种设计配置下,对比现有基于LLM的方法与人工设计,采用定量、定性指标及用户研究评估结果。结果表明,结构化使用LLMs可有效生成多样化高质量布局,为大规模虚拟场景构建提供可行方案。
原文摘要 · Abstract (English)
Interior design involves the careful selection and arrangement of objects to create an aesthetically pleasing, functional, and harmonized space that aligns with the client's design brief. This task is particularly challenging, as a successful design must not only incorporate all the necessary objects in a cohesive style, but also ensure they are arranged in a way that maximizes accessibility, while adhering to a variety of affordability and usage considerations. Data-driven solutions have been proposed, but these are typically room- or domain-specific and lack explainability in their design design considerations used in producing the final layout. In this paper, we investigate if large language models (LLMs) can be directly utilized for interior design. While we find that LLMs are not yet capable of generating complete layouts, they can be effectively leveraged in a structured manner, inspired by the workflow of interior designers. By systematically probing LLMs, we can reliably generate a list of objects along with relevant constraints that guide their placement. We translate this information into a design layout graph, which is then solved using an off-the-shelf constrained optimization setup to generate the final layouts. We benchmark our algorithm in various design configurations against existing LLM-based methods and human designs, and evaluate the results using a variety of quantitative and qualitative metrics along with user studies. In summary, we demonstrate that LLMs, when used in a structured manner, can effectively generate diverse high-quality layouts, making them a viable solution for creating large-scale virtual scenes. Project webpage at https://flairgpt.github.io/
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。