用草图和文字直接生成改造方案,省去繁琐建模
Sketch-Based Facade Renovation With Generative AI: A Streamlined Framework for Bypassing As-Built Modelling in Industrial Adaptive Reuse
- 用视觉语言模型解析草图,定位修改区域
- 扩散模型生成新元素,融合原结构细节
- 适合快速迭代设计,提升沟通效率
立面改造比全面拆除更可持续,但如何在保留原有结构的同时表达新设计理念仍具挑战。现有流程通常需先进行详细的竣工建模,耗时耗力且常需反复修改。为此,我们提出一个三阶段框架,结合生成式人工智能与视觉语言模型(VLM),直接处理粗糙的结构草图和文本描述,生成一致的改造方案。首先,微调的VLM模型根据输入草图预测需修改的边界框及应添加的构件;其次,稳定扩散模型生成新元素的详细草图,并通过生成式修复管道与原始轮廓融合;最后,ControlNet用于将结果优化为逼真图像。在真实工业建筑数据集上的实验表明,该框架能有效保留原有结构,同时提升立面细节质量。该方法显著规避了对详尽竣工建模的需求,使建筑师能够快速探索设计方案、迭代早期概念,并更清晰地传达改造意图。
原文摘要 · Abstract (English)
Facade renovation offers a more sustainable alternative to full demolition, yet producing design proposals that preserve existing structures while expressing new intent remains challenging. Current workflows typically require detailed as-built modelling before design, which is time-consuming, labour-intensive, and often involves repeated revisions. To solve this issue, we propose a three-stage framework combining generative artificial intelligence (AI) and vision-language models (VLM) that directly processes rough structural sketch and textual descriptions to produce consistent renovation proposals. First, the input sketch is used by a fine-tuned VLM model to predict bounding boxes specifying where modifications are needed and which components should be added. Next, a stable diffusion model generates detailed sketches of new elements, which are merged with the original outline through a generative inpainting pipeline. Finally, ControlNet is employed to refine the result into a photorealistic image. Experiments on datasets and real industrial buildings indicate that the proposed framework can generate renovation proposals that preserve the original structure while improving facade detail quality. This approach effectively bypasses the need for detailed as-built modelling, enabling architects to rapidly explore design alternatives, iterate on early-stage concepts, and communicate renovation intentions with greater clarity.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。