arXiv:2608.01753cs.CVcs.AI2026-08

用视觉语言模型分析城市破败,低成本实现大规模住房状况评估

Can Urban Blight Be Accessed with Vision-language Models: A Case Study in Detroit

论文配图:Can Urban Blight Be Accessed with Vision-language Models: A Case Study in Detroit
图 1 · 摘自论文原文
  • 用多视角图像+结构化提示,让大模型自动判断屋顶、墙体、门窗破损情况
  • 多视角输入提升准确率,集成学习模型表现优于单个模型
  • 适合城市规划、房产管理等需要高频更新房屋状况的场景

过去15年,城市破败问题日益受到关注。评估城市破败对指导城市规划、精准修复和保障公共健康至关重要,但传统住宅破败调查因人力成本高、周期长,难以规模化开展。本研究提出一种基于开源大型视觉语言模型的可扩展框架,利用多视角图像评估住宅状况。通过结构化提示引导模型识别屋顶完整性、墙体损伤及破损或封闭门窗等特征,输出二分类判断与破损概率估计。为评估性能,我们对比了多个模型在专业人工标注数据上的表现,包括基于XGBoost的集成堆叠方法和加权评分系统。结果表明:(i) 多个街景视角可提升评估准确性;(ii) 不同视觉语言模型在推理上各有优势;(iii) 集成学习模型优于单一基础模型,在各类住宅条件和破败程度下均更稳健。该方法可实现低成本、高频次的住房存量状态追踪与管理,为传统破败调查提供定期更新的补充方案。

原文摘要 · Abstract (English)

Addressing urban blight has seen increased focus in the past 15 years. Assessing urban blight is essential for guiding urban planning, targeting rehabilitation, and safeguarding public health, yet traditional residential blight surveys are difficult to maintain at scale due to the labor-intensive cost and long-term cycle. This study introduced a scalable framework for estimating residential blight using open-source large vision-language models on multiple views. Structured prompts guided models to evaluate housing attributes, including roof integrity, wall damage, and broken or boarded openings, producing both binary assessments and probabilistic estimates of disrepair. To evaluate the performance of these visual assessments, we compared professional human annotations of these features across several models, including an ensemble stacking approach based on XGBoost and a weighted scoring system. Results showed that (i) multiple street views can contribute to the improvement of accuracy, (ii) large vision-language models have different strengths of inference, (iii) the ensemble learner outperforms individual base models, enhancing robustness across all residential conditions and blight assessment. The practical application of the method allows low-cost tracking and management of housing stock conditions, providing a regularly updatable complement to traditional blight surveys.

城市治理视觉语言模型住房评估

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。