arXiv:2608.28665cs.CVcs.RO2026-08

通过三维融合分析无人机视觉中语义稳定性,发现观测重复性是长期可靠性关键。

Understanding Temporal Semantic Stability in Open-Vocabulary UAV Perception through Metric 3D Fusion

论文配图:Understanding Temporal Semantic Stability in Open-Vocabulary UAV Perception through Metric 3D Fusion
图 1 · 摘自论文原文
  • 用体素级框架融合多帧图像,定位语义预测在真实空间中的对应位置
  • 发现高整体一致性可能虚高,因部分区域观测次数少导致误判
  • 强调重复观测支持度是评估长期语义可靠性的核心条件,适合做无人机感知评估

近期开放词汇分割模型提升了无人机的语义感知能力,但移动平台上的重复观测常出现语义不一致。本文通过度量三维融合,将每帧预测与持久的世界坐标位置关联,提出体素级评估框架,联合分析最终语义一致性、语义信念漂移(SBD)、观测持续性(OP)和语义不确定性。在UAVid-3D数据集上的实验显示,存在显著的帧间语义闪烁现象;当世界空间位置缺乏足够重复观测支持时,高聚合一致性会夸大时间稳定性。分层分析表明,频繁出现的体素表现出更大语义分歧,而随着证据累积,信念漂移下降。该现象在两种分割主干网络及不同体素分辨率、几何关联方式和时间采样密度下均保持一致。减少世界空间重复性会提升表观聚合稳定性,说明语义一致性必须结合观测支持度共同解读。研究强调观测持续性是评估长时序语义可靠性的重要调节变量。

原文摘要 · Abstract (English)

Recent open-vocabulary segmentation models have advanced semantic perception for UAVs, but predictions from moving aerial platforms can remain temporally inconsistent across repeated observations of the same physical scene. We investigate temporal semantic stability by associating frame-wise predictions with persistent world-space locations through metric 3D fusion. We introduce a voxel-level evaluation framework that jointly characterises final semantic agreement, Semantic Belief Drift (SBD), Observation Persistence (OP), and semantic uncertainty. Experiments on UAVid-3D reveal substantial frame-wise semantic flicker and show that high aggregate world-space agreement can overstate temporal stability when locations have limited repeated-observation support. Persistence-stratified analysis shows that recurrent voxels expose greater semantic disagreement, while belief drift decreases as additional evidence accumulates. This behaviour is observed across two segmentation backbones and remains consistent under variations in voxel resolution, geometric association, and temporal sampling density. Conditions that reduce world-space recurrence can increase apparent aggregate stability, demonstrating that semantic consistency must be interpreted together with observation support. Our findings highlight observation persistence as an essential conditioning variable for evaluating long-horizon semantic reliability.

无人机感知语义稳定性三维融合体素评估

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。