arXiv:2603.04277cs.ROcs.AI2026-03

用无人机检测恢复航拍图绝对尺度,误差仅6.87%。

VehAnchor: Metadata-Free Metric Scale Recovery from Vehicle Cues in Aerial Imagery

  • 通过检测车辆轮廓估计像素尺度,再转换为地面采样距离。
  • 在DOTA数据集上中位数误差6.87%,面积估算误差19.7%。
  • 适合需要安全空间推理的自主飞行系统使用。

在无GPS或通信受限环境下,自主飞行机器人常丢失相机元数据与遥测信息,导致无法恢复场景的绝对度量尺度。我们实验发现,五种先进视觉语言模型存在严重空间尺度幻觉,中位面积误差超50%。为此提出VehAnchor,一种轻量级、确定性的几何感知技能,可被任何基于大模型的代理调用。该工具利用航拍图像中普遍存在的小车目标(通过定向边界框检测),通过核密度估计稳健获取其像素长度,并结合预标定参考长度转换为地面采样距离(GSD)。输出包含GSD估计值和综合置信度评分,使调用者可自主判断是否信任结果并启用备用策略。在DOTA v1.5基准上,VehAnchor实现6.87%的中位数GSD误差(306张图像)。集成基于SAM的分割后,下游面积测量中位误差降至19.7%(100项测试),类别依赖性降低2.6倍,灾难性失败减少4倍,优于最优的VLM基线,证明为智能体配备确定性几何工具对安全空间推理至关重要。

原文摘要 · Abstract (English)

Autonomous aerial robots operating in GPS-denied or communication-degraded environments frequently lose access to camera metadata and telemetry, leaving onboard perception systems unable to recover the absolute metric scale of the scene. As LLM/VLM-based planners are increasingly adopted as high-level agents for embodied systems, their ability to reason about physical dimensions becomes safety-critical -- yet our experiments show that five state-of-the-art VLMs suffer from \emph{spatial scale hallucinations}, with median area estimation errors exceeding 50\%. We propose VehAnchor, a lightweight, deterministic \emph{Geometric Perception Skill} designed as a callable tool that any LLM-based agent can invoke to recover Ground Sample Distance (GSD) from ubiquitous environmental anchors: small vehicles detected via oriented bounding boxes, whose modal pixel length is robustly estimated through kernel density estimation and converted to GSD using a pre-calibrated reference length. The tool returns both a GSD estimate and a composite confidence score, enabling the calling agent to autonomously decide whether to trust the measurement or fall back to alternative strategies. On the DOTA~v1.5 benchmark, VehAnchor achieves 6.87\% median GSD error on 306~images. Integrated with SAM-based segmentation for downstream area measurement, the pipeline yields 19.7\% median error on a 100-entry benchmark -- with 2.6$\times$ lower category dependence and 4$\times$ fewer catastrophic failures than the best VLM baseline -- demonstrating that equipping agents with deterministic geometric tools is essential for safe autonomous spatial reasoning.

航拍图像尺度恢复几何感知自动驾驶

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。