arXiv:2503.14754cs.LGcs.AI2025-03被引 4

用零样本模型加贝叶斯建模,自动发现城市内被忽略的洪水高风险区。

Bayesian Modeling of Zero-Shot Classifications for Urban Flood Detection

论文配图:Bayesian Modeling of Zero-Shot Classifications for Urban Flood Detection
图 1 · 摘自论文原文
  • 先用预训练视觉语言模型做零样本洪水检测,无需标注数据
  • 再用空间贝叶斯模型融合结果,提升预测准确率并量化不确定性
  • 可识别11万+被现有方法遗漏的高风险人群,适合城市防灾研究者

街景数据集(如街景或车载摄像头采集)为检测城市内如道路积水等事件提供了新可能。但主要挑战在于缺乏可靠标签:事件类型繁多、发生频率低,且真实位置信息缺失。为此,我们提出BayFlood——一种两阶段方法。第一阶段使用预训练视觉语言模型(VLM)进行零样本分类,判断事件发生位置;第二阶段在VLM输出上构建空间贝叶斯模型。该方法避免了大规模标注需求,同时提供不确定性度量、位置平滑和外部数据融合能力(如雨水积聚区)。我们在多个城市和时间段验证该方法,发现VLM能有效捕捉洪水信号,贝叶斯模型相比基线方法显著提升外样本预测性能,且推断出的洪水风险与已知风险因子高度相关。进一步分析显示,当前方法遗漏了113,738名高风险居民,存在人口统计学偏差,并可指导新增传感器布设。本研究证明,对零样本模型输出进行贝叶斯建模是一种高效范式,既利用了大模型能力,又保留了贝叶斯模型的表达力与不确定性量化优势。

原文摘要 · Abstract (English)

Street scene datasets, collected from Street View or dashboard cameras, offer a promising means of detecting urban objects and incidents like street flooding. However, a major challenge in using these datasets is their lack of reliable labels: there are myriad types of incidents, many types occur rarely, and ground-truth measures of where incidents occur are lacking. Here, we propose BayFlood, a two-stage approach which circumvents this difficulty. First, we perform zero-shot classification of where incidents occur using a pretrained vision-language model (VLM). Second, we fit a spatial Bayesian model on the VLM classifications. The zero-shot approach avoids the need to annotate large training sets, and the Bayesian model provides frequent desiderata in urban settings - principled measures of uncertainty, smoothing across locations, and incorporation of external data like stormwater accumulation zones. We comprehensively validate this two-stage approach, showing that VLMs provide strong zero-shot signal for floods across multiple cities and time periods, the Bayesian model improves out-of-sample prediction relative to baseline methods, and our inferred flood risk correlates with known external predictors of risk. Having validated our approach, we show it can be used to improve urban flood detection: our analysis reveals 113,738 people who are at high risk of flooding overlooked by current methods, identifies demographic biases in existing methods, and suggests locations for new flood sensors. More broadly, our results showcase how Bayesian modeling of zero-shot LM annotations represents a promising paradigm because it avoids the need to collect large labeled datasets and leverages the power of foundation models while providing the expressiveness and uncertainty quantification of Bayesian models.

洪水检测零样本贝叶斯建模城市安全

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。