用视觉语言模型直接定位海岸线几何边界,比传统像素分割更准。
Geometric Coastline Localization using Vision-Language Models

- 将海岸线提取从像素分割改为几何边界定位,输出为折线
- 在新西兰数据集上,霍夫德距离降低至31.84米,地球移动距离降至17.32米
- 适合需要精确几何形状的海岸变化监测与地理信息系统应用
遥感影像中的海岸线检测通常被建模为像素级分割任务,最终通过后处理从预测掩码中提取海岸线。这种范式将海岸线几何结构——海岸变化分析的核心表示——置于次要地位。实际上,海岸线由地貌代理(如植被线、沙丘脚、悬崖边缘)定义,而非像素分割中常用的瞬时陆海边界。本文从表征视角重新审视海岸线提取,将其建模为几何边界定位任务。我们基于新西兰海岸变化数据集(NZCCD)和新西兰土地信息局(LINZ)的高分辨率航空影像,构建了基于GeoChat-7B/LLaVA-1.5架构的视觉语言模型CoastlineVLM-7B,实现海岸线存在性检测、代理类型分类与海岸线定位的联合建模。该模型直接输出海岸线折线而非密集掩码。在严格一像素边界监督下评估,结果表明几何度量(如霍夫德距离、地球移动距离)比交并比(IoU)更适合作为海岸线定位质量评估指标。相比基线,CoastlineVLM-7B在全球几何对齐上显著提升:霍夫德距离从37.74米降至31.84米,地球移动距离从21.12米降至17.32米。这表明输出表征是海岸线提取的关键设计因素,而面向几何的建模结合视觉语言模型的语义推理能力,与实际海岸线定义和评估方式高度契合。
原文摘要 · Abstract (English)
Coastline detection in remote sensing imagery is commonly formulated as a pixel-wise segmentation problem, where the final coastline is extracted from a predicted mask through post-processing. This formulation relegates coastline geometry, the primary representation used in coastal change analysis, to a secondary artifact rather than the learning objective. In practice, coastlines are defined by geomorphic proxies such as vegetation lines, dune toes, or cliff edges, rather than an instantaneous land-water boundary often used in pixel-based segmentation approaches. In this work, we revisit coastline extraction from a representation perspective and formulate the task as geometric boundary localization. We use the New Zealand Coastal Change Dataset (NZCCD) and high-resolution aerial imagery from Land Information New Zealand (LINZ) to develop CoastlineVLM-7B, a vision-language model (VLM) built on the GeoChat-7B/LLaVA-1.5 architecture that jointly performs coastline presence detection, proxy-type classification, and coastline grounding. The model directly predicts a coastline as a polyline rather than a dense segmentation mask. We evaluate CoastlineVLM-7B against segmentation baselines under strict one-pixel boundary supervision. Results show that geometry-based metrics are more suitable for assessing coastline localization quality than pixel-overlap metrics such as Intersection over Union (IoU). CoastlineVLM-7B improves global geometric alignment with reference coastlines, reducing Hausdorff distance from 37.74 m to 31.84 m and Earth Mover's Distance from 21.12 m to 17.32 m. These results indicate that output representation is a critical design choice in coastline extraction, and that geometry-oriented learning, combined with the semantic reasoning capabilities of vision-language models, aligns well with how coastlines are defined and evaluated in operational coastal monitoring.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。