arXiv:2608.18479cs.CV2026-08

无需训练即可在飞行点云中实现跨域开放集分割,支持新增类别

COSTA: A Cluster-Centric Paradigm for Annotation-Free Open-Set Semantic Segmentation of Aerial Point Clouds with Domain Shifts

论文配图:COSTA: A Cluster-Centric Paradigm for Annotation-Free Open-Set Semantic Segmentation of Aerial Point Clouds with Domain Shifts
图 1 · 摘自论文原文
  • 以聚类为中心的推理时自适应,突破封闭集限制
  • 在三个不同数据集上达到最高70.09% mIoU,支持新增类别分割
  • 适合需要快速适配新场景且无标签数据的遥感应用

航拍点云语义分割在不同域之间存在泛化危机。尽管测试时自适应能在推理阶段无须额外训练地适配预训练模型至未标注目标域数据,但现有方法受限于封闭集标签假设和不可扩展的逐点分割流程,仍难以应对语义变化。本文提出COSTA,将方法从封闭集逐点自适应转向聚类中心式开放集语义传播。核心发现是:经过有效测试时适配后,航拍点云丰富的特征分布可提炼为一组分离良好的语义中心,具备跨标签空间迁移能力。COSTA通过三步实现:先利用成熟测试时自适应弥合域间差距;再基于适配后特征空间中的相似性分布,将目标域点分组为少量语义聚类;最后通过聚类级投票,将开放词汇视觉语言模型获得的高置信伪标签传播至所有点。该聚类中心范式在显著域偏移下实现航拍点云测试时自适应,以DALES为源域,在三个具有不同域和异构类别空间的航拍点云基准上实现按需分割,最高达70.09% mIoU。

原文摘要 · Abstract (English)

Semantic segmentation of aerial point cloud is trapped in a generalization crisis under distinct domain shifts. While test-time adaptation offers a privacy-preserving and computationally efficient way to adapt pre-trained models to unlabeled target-domain data during inference, existing methods, bound to closed-set label assumptions and non-scalable point-wise segmentation pipelines, still struggle with semantic shifts. We ask: can we adapt any given pre-trained aerial point cloud segmentation model to a shifted target domain at the inference phase alone, without additional training, while segmenting target-specific categories beyond the source label space on demand? This paper introduces COSTA, which breaks this limitation by shifting from closed-set point-wise adaptation to cluster-centric open-set semantic propagation. Our core discovery is that, once effectively adapted at test time, the rich feature distribution of aerial point clouds can be distilled into a compact set of well-separated semantic centroids that are transferable across label spaces. COSTA leverages this to reformulate open-set semantic segmentation as a cluster-level propagating process: it first bridges the domain gap through proven test-time adaptation, then groups each batch of target-domain points into a small set of semantic clusters based on the similarity distribution in the adapted feature space, and finally propagates high-confidence pseudo labels obtained from an open-vocabulary vision-language model to all points through cluster-level voting. This cluster-centric paradigm enables test-time adaptation of aerial point clouds under significant domain gaps with mixed semantic shifts. With DALES as the source domain, COSTA enables on-demand segmentation across three aerial point cloud benchmarks with distinct domains and heterogeneous category spaces, achieving up to 70.09% mIoU under this new setting.

点云分割开放集学习测试时自适应遥感

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。