通过查询机制与更大上下文提升户外细粒度语义分割性能
Technical Report for ICRA 2026 GOOSE 2D Fine-Grained Semantic Segmentation Challenge: Exploring Query-Based Segmentation and Increased Spatial Context for Outdoor Scene Understanding

- 采用基于查询的Mask2Former架构替代基础模型
- 训练时增大图像裁剪尺寸,提升场景上下文保留
- 结合测试时增强,实现69.6% mIoU,适合户外感知研究
本文介绍我们提交至ICRA 2026场外机器人研讨会举办的GOOSE 2D细粒度语义分割挑战赛的作品。挑战数据来自GOOSE和GOOSE-Ex数据集,包含超过13,000张图像,由4种不同相机设置采集,使用56个细粒度类别和11个广义类别构成的层级标签体系进行标注。以SegFormer为基线,我们通过增加训练图像裁剪尺寸、迁移到基于查询的Mask2Former架构以及测试时增强逐步提升分割性能。实验表明,查询式分割显著优于基线模型;训练时扩大裁剪尺寸带来明显提升,凸显保留场景上下文对细粒度语义消歧的重要性。最终方案结合测试时增强,在测试集上达到69.6% mIoU,为户外环境下的细粒度语义分割提供了强基准。为促进可复现性与后续研究,代码与权重将公开于https://github.com/RoboticsLabURJC/outdoor-fine-grained-segmentation。
原文摘要 · Abstract (English)
In this report, we present our submission to the GOOSE 2D Fine-Grained Semantic Segmentation Challenge, organized as part of the Workshop on Field Robotics at ICRA 2026. The challenge combines data from the GOOSE and GOOSE-Ex datasets, which comprise more than 13k images captured from 4 distinct camera setups, annotated using a hierarchical taxonomy of 56 fine-grained classes and 11 broader categories. Starting from SegFormer as a baseline, we progressively improve segmentation performance through increased training crop sizes, a transition to the query-based Mask2Former architecture, and test-time augmentation. Our experiments show that query-based segmentation significantly outperforms the baseline model. Furthermore, increasing the crop size used during training yields substantial gains, highlighting the relevance of preserving scene context for fine-grained semantic disambiguation. Our final submission, using test-time augmentation, achieves an mIoU of 69.6% on the challenge test set, providing a strong baseline for fine-grained semantic segmentation in outdoor environments. To facilitate reproducibility and future research, code and weights will be made publicly available at https://github.com/RoboticsLabURJC/outdoor-fine-grained-segmentation .
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。