用街景图和视觉大模型预测瑞典建筑遗产价值，支持翻新政策制定。
Using street view images and visual LLMs to predict heritage values for governance support: Risks, ethics, and policy implications
- 通过视觉大模型分析15万张街景图，识别具遗产价值的建筑特征。
- 覆盖500万平方米供暖面积，零样本预测发现潜在遗产建筑。
- 揭示模型误判、透明度不足等风险，为政策应用提供伦理警示。
2025至2026年，欧盟将实施建筑能效指令，要求各成员国制定国家建筑翻新计划。瑞典目前缺乏全面的具有遗产价值建筑注册系统，成为相关决策分析的障碍。本研究旨在协助瑞典当局获取建筑遗产信息。基于瑞典全国范围内的154,710张街景图像，利用多模态大语言模型（LLM）评估可见的遗产价值特征。采用零样本预测方法，识别出约500万平方米供暖面积内具有潜在遗产价值的建筑。本文呈现预测结果及经验教训，并与瑞典建筑翻新计划的治理需求相联系。同时讨论了该方法存在的问题及改进方向，重点分析了公共部门使用基于LLM数据所带来的风险，包括透明度不足、错误检测困难以及模型过度迎合等问题。
原文摘要 · Abstract (English)
During 2025 and 2026, the Energy Performance of Buildings Directive is being implemented in the European Union member states, requiring all member states to have National Building Renovation Plans. In Sweden, there is no comprehensive national register of buildings with heritage values. This is seen as a barrier for the analyses underlying the development of Building Renovation Plans by the involved Swedish authorities. The purpose of this research was to assist Swedish authorities in developing information on heritage values in the Swedish building stock. Buildings in street view images from all over Sweden (N=154 710) have been analysed using multimodal Large Language Models (LLM) to assess visible aspects indicative of heritage value. Zero-shot predictions by LLMs were used as a basis for identifying buildings with potential heritage values for 5.0 million square meters of heated floor area. In this paper, the results of the predictions and lessons learned are presented and related to the development of the Swedish Building Renovation Plan as part of governance. The problems with the method and potential improvements are discussed. Risks with authorities use of LLM-based data are addressed, with a focus on issues of transparency, error detection and sycophancy.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品；中文卡片由大模型生成，请以原文为准。