用可控扩散模型生成符合实际需求的室内设计,提升效率与准确性。
DiffDesign: Controllable Diffusion with Meta Prior for Efficient Interior Design Generation
- 利用预训练扩散模型作为渲染基础,通过解耦注意力控制外观、姿态和尺寸等属性。
- 构建包含400多个方案的DesignHelper数据集,用于精细化调优模型。
- 支持多视角一致生成,适合需要快速产出高质量设计的从业者。
室内设计是一门涉及美学、功能性、人体工学和材料科学的复杂创造性学科,通常需产出多视角渲染图与设计图纸,过程效率低且依赖创意。随着机器学习发展,生成模型可通过文本或草图生成设计,但现有工作极少聚焦室内设计,导致输出与实际需求存在尺寸、空间范围和可控性差距。为此,我们提出DiffDesign,一种具有元先验的可控扩散模型,用于高效生成室内设计。具体地,采用在大规模图像数据集上预训练的2D扩散模型作为渲染主干,通过解耦交叉注意力机制分别控制设计属性(如外观、姿态、尺寸),并引入基于最优传输的对齐模块以保证多视角一致性。同时,我们构建了面向室内设计的专用数据集DesignHelper,包含超过400个解决方案,覆盖15种空间类型与15种设计风格,用于模型微调。在多个基准数据集上的实验表明,DiffDesign在生成质量与鲁棒性方面均表现优异。
原文摘要 · Abstract (English)
Interior design is a complex and creative discipline involving aesthetics, functionality, ergonomics, and materials science. Effective solutions must meet diverse requirements, typically producing multiple deliverables such as renderings and design drawings from various perspectives. Consequently, interior design processes are often inefficient and demand significant creativity. With advances in machine learning, generative models have emerged as a promising means of improving efficiency by creating designs from text descriptions or sketches. However, few generative works focus on interior design, leading to substantial discrepancies between outputs and practical needs, such as differences in size, spatial scope, and the lack of controllable generation quality. To address these challenges, we propose DiffDesign, a controllable diffusion model with meta priors for efficient interior design generation. Specifically, we utilize the generative priors of a 2D diffusion model pre-trained on a large image dataset as our rendering backbone. We further guide the denoising process by disentangling cross-attention control over design attributes, such as appearance, pose, and size, and introduce an optimal transfer-based alignment module to enforce view consistency. Simultaneously, we construct an interior design-specific dataset, DesignHelper, consisting of over 400 solutions across more than 15 spatial types and 15 design styles. This dataset helps fine-tune DiffDesign. Extensive experiments conducted on various benchmark datasets demonstrate the effectiveness and robustness of DiffDesign.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。