arXiv:2605.27644cs.ROcs.AI2026-05

统一处理地形与语义分割,让机器人跨平台理解复杂户外环境。

Trinity: Unifying Class-Agnostic Terrain and Semantic Segmentation for Unstructured Outdoor Environments by Leveraging Synthetic Data

论文配图:Trinity: Unifying Class-Agnostic Terrain and Semantic Segmentation for Unstructured Outdoor Environments by Leveraging Synthetic Data
图 1 · 摘自论文原文
  • 用统一网络同时做有类和无类的地形分割,基于视觉外观而非预设标签。
  • 在真实场景中实现高精度联合分割,支持多任务下游应用。
  • 自建合成数据集与真实数据集,适配无人车、无人机等移动机器人。

在非结构化户外环境中,地形理解对移动机器人至关重要。现有基于视觉的可通行性估计方法依赖于特定机器人标注或预定义语义类别,导致平台间迁移性差,且当机器人能力变化时需重新标注,成本高昂;而标准语义分割仅关注特定预设类别,无法覆盖多样地形。本文提出一种基于Transformer的统一架构Trinity,联合执行特定类别的语义分割与无类别的地形分割。地形区域仅依据视觉外观进行分割,无需预设语义标签或机器人相关的可通行性评分。该设计使模型能学习通用的视觉地形先验,结合具体机器人经验用于可通行性估计、视觉里程计和任务规划等下游任务。为支持大规模多样化训练,我们扩展了OAISYS仿真器,引入受RUGD启发的无类地形合成数据集RUGDSynth;同时构建了包含类别级与无类别地形标注的真实世界图像数据集EXTerra。实验验证了该任务的可行性及联合分割方法在复杂户外环境中的有效性。代码与数据集将在论文发表后公开。

原文摘要 · Abstract (English)

Terrain understanding is fundamental for mobile robots operating in unstructured outdoor environments. Existing vision-based traversability estimation methods rely on robot-specific annotations or semantic class mappings, limiting transferability across platforms and requiring costly re-annotation when robot capabilities change, while standard semantic segmentation methods only focus on specific predefined classes, which do not capture the variety of terrains. In this work, we propose a transformer-based architecture that jointly performs class-specific semantic segmentation and class-agnostic terrain segmentation within a unified network, called Trinity. Terrain regions are segmented based solely on visual appearance, without predefined semantic labels or robot-dependent traversability scores. This formulation enables the learning of robot-agnostic visual terrain priors that can be combined with robot-specific experience for downstream tasks such as traversability estimation, visual odometry, and mission planning. To enable large-scale training with diverse terrain appearances, we extend the OAISYS simulator and introduce RUGDSynth, a synthetic dataset inspired by RUGD with class-agnostic terrain samples. Furthermore, we present the EXTerra Dataset, providing real-world images annotated with both class-specific and class-agnostic terrain labels. Experiments demonstrate the feasibility of the proposed task and the effectiveness of our joint segmentation approach in complex outdoor environments. Code and datasets will be released with this publication (after review).

地形分割机器人感知合成数据统一框架

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。