用新卫星影像实现高精度单目建筑高度估计,效果优于现有方法。
The First Assessment of PhiSat-2 Imagery for Monocular Building Height Estimation
- 构建双流网络,联合学习高度与轮廓,利用空间谱信息
- 在26个城市9475张图像上,误差降低超13%,分割指标提升超14%
- 首次系统评估菲萨特-2卫星数据适用性,适合城市建模研究者
从光学影像中进行单目建筑高度估计对刻画城市垂直结构至关重要,但受城市建筑形态多样性和影像外观与高度间间接关系的挑战。新发射的PhiSat-2卫星提供开放获取数据,具备4.75米空间分辨率和覆盖可见至近红外波段的七个多光谱波段。然而其在单目建筑高度估计中的适用性尚未系统评估。本研究通过构建PhiSat-2--Height数据集(PHDataset)并提出两流序数网络(TSONet),开展初步公开基准评估。PHDataset整合全球PhiSat-2影像与公开建筑高度参考数据,包含来自26个城市的9,475对配准图像块。TSONet联合学习密集高度估计与辅助轮廓预测,采用轮廓感知结构引导和序数高度建模以更好利用PhiSat-2的空间-光谱信息。具体地,交叉流交换模块(CSEM)实现高度与轮廓流间的自适应交互,特征增强二分细化模块(FEBR)通过多层级特征实现粗到精的序数查询优化。在PHDataset上的实验表明,TSONet优于代表性对比方法,平均绝对误差(MAE)和均方根误差(RMSE)分别降低超过13.2%和9.7%,同时交并比(IoU)和F1分数提升超过14.0%和10.1%。额外分析进一步表明,PhiSat-2影像在中等空间分辨率下蕴含可用于单目建筑高度估计的有效空间-光谱线索。
原文摘要 · Abstract (English)
Monocular building height estimation from optical imagery is important for characterizing urban vertical structure, yet remains challenging due to the heterogeneity of urban building morphology and the indirect relationship between optical image appearance and building height. The recently launched PhiSat-2 satellite provides a promising open-access data source for this task, with 4.75m spatial resolution and seven multispectral bands spanning the visible to near-infrared range. However, its suitability for monocular building height estimation has not been systematically assessed. This study presents an initial open-reference assessment of PhiSat-2 imagery for this task by constructing a PhiSat-2--Height Dataset (PHDataset) and proposing a Two-Stream Ordinal Network (TSONet). PHDataset integrates global PhiSat-2 imagery with open building-height references and contains 9,475 co-registered patch pairs from 26 cities worldwide. TSONet jointly learns dense height estimation and auxiliary footprint prediction, using footprint-aware structural guidance and ordinal height modeling to better exploit PhiSat-2 spatial--spectral information. Specifically, a Cross-Stream Exchange Module (CSEM) enables adaptive interaction between the height and footprint streams, while a Feature-Enhanced Bin Refinement (FEBR) module performs coarse-to-fine ordinal query refinement with multi-level features. Experiments on PHDataset show that TSONet outperforms representative competing methods, reducing MAE and RMSE by over 13.2% and 9.7%, respectively, while improving IoU and F1-score by over 14.0% and 10.1%. Additional analyses further indicate that PhiSat-2 imagery contains useful spatial--spectral cues for monocular building height estimation at an intermediate spatial resolution.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。