arXiv:2608.04560cs.CVcs.GR2026-08

让3D高斯点云理解户外无人机场景的文本指令,提升远距离与遮挡下的语义准确性。

OutLangSplat: 3D Language Gaussian Splatting for UAV Outdoor Scenes

论文配图:OutLangSplat: 3D Language Gaussian Splatting for UAV Outdoor Scenes
图 1 · 摘自论文原文
  • 双分支2D-3D对齐融合增强空间一致性,减少误激活和漏检
  • 无需训练的贡献与一致性感知聚合,抑制噪声视角干扰
  • 首个公开的无人机户外开放词汇3D场景数据集,适合自动驾驶等应用

3D语言高斯点云将开放词汇语言特征嵌入3D高斯点云,实现高效显式表示,支持文本驱动的3D场景理解。然而现有方法仅限于室内或小范围场景,在无人机(UAV)户外场景中表现不佳,因严重遮挡和远距离视角常导致错误语义激活和目标响应缺失。本文提出OutLangSplat,通过改进特征表示与聚合可靠性,适配无人机户外场景。在特征表示上,设计2D-3D双分支结构,结合区域对齐与融合,提升空间一致性,降低目标响应不完整与背景误激活。在特征聚合上,引入无需训练的贡献与一致性感知策略,利用像素贡献可靠性和跨视角语义一致性,抑制噪声视角带来的不可靠响应。构建了一个新数据集,手动标注了四个真实世界公开无人机户外场景数据集中的多种物体。据我们所知,这是首个面向无人机户外场景的开放词汇3D场景理解公开数据集。定量评估与消融实验表明,OutLangSplat在开放词汇语义分割与实例定位任务上均优于现有最先进方法。代码与数据集将开源。

原文摘要 · Abstract (English)

3D Language Gaussian Splatting embeds open-vocabulary language features into 3D Gaussian Splatting, providing an efficient explicit representation for text-driven 3D scene understanding. However, existing methods are limited to indoor or small-scale scenes, and tend to fail in Unmanned Aerial Vehicle (UAV) outdoor scenes, where severe occlusions and long distance viewpoints often lead to incorrect semantic activations and missing target responses. In this paper, we present OutLangSplat which adapts language Gaussian representations to UAV outdoor scenes by improving feature representation and aggregation reliability. For the feature representation, a 2D-3D dual-branch representation with region-based alignment and fusion is designed to improve spatial consistency, reducing incomplete target responses and background misactivations. For the feature aggregation, we introduce a training-free contribution and consistency-aware Gaussian feature aggregation strategy that leverages pixel contribution reliability and cross-view semantic consistency to suppress unreliable responses from noisy viewpoints. A new dataset is provided by manually annotating various objects on four real-world public UAV outdoor scene datasets. To the best of our knowledge, it is the first accessible dataset of open-vocabulary 3D scene understanding for UAV outdoor scenes. Quantitative evaluations and ablation studies demonstrate that OutLangSplat outperforms SOTA methods on both open-vocabulary semantic segmentation and instance localization tasks. The datasets and codes will be open-sourced.

3D生成无人机语言模型高斯点云

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。