用街景图和大模型构建城市建筑外立面数据库,助力可持续城市设计。
BuildingView: Constructing Urban Building Exteriors Databases with Street View Imagery and Multimodal Large Language Mode
- 融合街景图与地图数据,自动识别建筑外立面特征。
- 在纽约、阿姆斯特丹、新加坡验证,提取能源与设计关键指标。
- 适合城市规划、建筑设计与环境政策研究者使用。
城市建筑外立面在城市分析中日益重要,得益于街景影像技术的进步及其与城市研究的融合。多模态大语言模型(LLMs)为城市标注提供了强大工具,有助于深入理解城市环境。然而,在构建准确详尽的城市建筑外立面数据库、识别能效、环境可持续性及以人为本设计的关键指标,以及系统化组织这些指标方面仍存在挑战。为此,我们提出 BuildingView,一种新方法,通过 Overpass API 将谷歌街景的高分辨率视觉数据与开放街图的空间信息相结合。该研究提升了城市建筑外立面数据的准确性,识别了关键可持续性与设计指标,并建立了提取与分类框架。方法包括系统文献综述、建筑与街景采样,以及使用 ChatGPT-4O API 进行标注。最终数据库在纽约市、阿姆斯特丹和新加坡进行验证,为城市研究提供全面工具,支持城市规划、建筑设计与环境政策中的决策。BuildingView 代码已开源:https://github.com/Jasper0122/BuildingView。
原文摘要 · Abstract (English)
Urban Building Exteriors are increasingly important in urban analytics, driven by advancements in Street View Imagery and its integration with urban research. Multimodal Large Language Models (LLMs) offer powerful tools for urban annotation, enabling deeper insights into urban environments. However, challenges remain in creating accurate and detailed urban building exterior databases, identifying critical indicators for energy efficiency, environmental sustainability, and human-centric design, and systematically organizing these indicators. To address these challenges, we propose BuildingView, a novel approach that integrates high-resolution visual data from Google Street View with spatial information from OpenStreetMap via the Overpass API. This research improves the accuracy of urban building exterior data, identifies key sustainability and design indicators, and develops a framework for their extraction and categorization. Our methodology includes a systematic literature review, building and Street View sampling, and annotation using the ChatGPT-4O API. The resulting database, validated with data from New York City, Amsterdam, and Singapore, provides a comprehensive tool for urban studies, supporting informed decision-making in urban planning, architectural design, and environmental policy. The code for BuildingView is available at https://github.com/Jasper0122/BuildingView.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。