用单张照片自动定位城市物体,提升数字孪生更新效率
MapAnything: Evaluating Monocular Metric Depth Models for 3D Urban Asset Localization
- 基于单目深度模型与相机参数,将2D图像转为3D地理坐标
- 在复杂城区对比LiDAR数据,距离估计误差在不同距离段均低于1.5米
- 可直接用于交通标志、路面损毁等场景的自动化城市资产普查
城市管理部门越来越依赖城市资产(如交通标志、树木)和事件(如涂鸦、道路损坏)的综合数据库与数字孪生系统,以全面掌握城市状况。数字化提升了对持续更新的空间数据集的需求,但当前的数据采集与维护仍需大量人工操作,面临显著的可扩展性挑战。本文提出MapAnything,一个系统化的评估流程,可从单张单目图像中自动完成城市物体与事件的空间映射。通过利用先进的度量深度估计模型,MapAnything准确计算物体地理坐标,将2D图像数据转化为有价值的3D空间信息。该方法结合估算的相机-物体距离、几何原理及已知相机参数。我们对框架进行了详细验证,在复杂城市环境中将其距离估计精度与高精度激光雷达点云进行对比。评估提供了在不同距离区间和语义区域(如道路、植被)下的细粒度空间性能分析。最后,我们通过具体应用案例展示了框架的实际有效性,包括交通标志与路面破损的映射,并为将其集成到自动化城市资产管理系统提供建议。
原文摘要 · Abstract (English)
City administrations increasingly rely on comprehensive databases and digital twins of city assets, such as traffic signs and trees, as well as incidents such as graffiti or road damage, to maintain an effective overview of urban conditions. Digitization has increased the demand for continuously updated spatial datasets, yet current data acquisition and maintenance processes still involve considerable manual effort, posing significant scalability challenges. This paper introduces MapAnything, a systematic evaluation pipeline that automates the spatial mapping of urban objects and incidents from a single monocular image. By leveraging advanced Metric Depth Estimation models, MapAnything accurately calculates object geocoordinates, converting 2D image data into valuable 3D spatial information. The methodology integrates the estimated camera-to-object distance with geometric principles and known camera specifications. We present a detailed validation of the framework, comparing its distance-estimation accuracy against high-precision LiDAR point clouds in complex urban environments. Our evaluation provides a granular analysis of spatial performance across various distance intervals and semantic areas, such as roads and vegetation. Finally, we demonstrate the framework's practical efficacy through specific use cases, including mapping traffic signs and road pavement damage, and provide recommendations for its integration into automated urban inventory systems.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。