用无人机检测恢复航拍图绝对尺度,误差仅6.87%。
VehAnchor: Metadata-Free Metric Scale Recovery from Vehicle Cues in Aerial Imagery
- 通过检测车辆轮廓估计像素尺度,再转换为地面采样距离。
- 在DOTA数据集上中位数误差6.87%,面积估算误差19.7%。
- 适合需要安全空间推理的自主飞行系统使用。
在无GPS或通信受限环境下,自主飞行机器人常丢失相机元数据与遥测信息,导致无法恢复场景的绝对度量尺度。我们实验发现,五种先进视觉语言模型存在严重空间尺度幻觉,中位面积误差超50%。为此提出VehAnchor,一种轻量级、确定性的几何感知技能,可被任何基于大模型的代理调用。该工具利用航拍图像中普遍存在的小车目标(通过定向边界框检测),通过核密度估计稳健获取其像素长度,并结合预标定参考长度转换为地面采样距离(GSD)。输出包含GSD估计值和综合置信度评分,使调用者可自主判断是否信任结果并启用备用策略。在DOTA v1.5基准上,VehAnchor实现6.87%的中位数GSD误差(306张图像)。集成基于SAM的分割后,下游面积测量中位误差降至19.7%(100项测试),类别依赖性降低2.6倍,灾难性失败减少4倍,优于最优的VLM基线,证明为智能体配备确定性几何工具对安全空间推理至关重要。
原文摘要 · Abstract (English)
Autonomous aerial robots operating in GPS-denied or communication-degraded environments frequently lose access to camera metadata and telemetry, leaving onboard perception systems unable to recover the absolute metric scale of the scene. As LLM/VLM-based planners are increasingly adopted as high-level agents for embodied systems, their ability to reason about physical dimensions becomes safety-critical -- yet our experiments show that five state-of-the-art VLMs suffer from \emph{spatial scale hallucinations}, with median area estimation errors exceeding 50\%. We propose VehAnchor, a lightweight, deterministic \emph{Geometric Perception Skill} designed as a callable tool that any LLM-based agent can invoke to recover Ground Sample Distance (GSD) from ubiquitous environmental anchors: small vehicles detected via oriented bounding boxes, whose modal pixel length is robustly estimated through kernel density estimation and converted to GSD using a pre-calibrated reference length. The tool returns both a GSD estimate and a composite confidence score, enabling the calling agent to autonomously decide whether to trust the measurement or fall back to alternative strategies. On the DOTA~v1.5 benchmark, VehAnchor achieves 6.87\% median GSD error on 306~images. Integrated with SAM-based segmentation for downstream area measurement, the pipeline yields 19.7\% median error on a 100-entry benchmark -- with 2.6$\times$ lower category dependence and 4$\times$ fewer catastrophic failures than the best VLM baseline -- demonstrating that equipping agents with deterministic geometric tools is essential for safe autonomous spatial reasoning.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。