解决遥感点云分割中无源域自适应难题,无需源数据即可提升模型泛化能力。
Source-Free Domain Adaptation for Geospatial Point Cloud Semantic Segmentation
- 提出局部-全局双共识框架,仅用预训练模型和目标域无标签数据。
- 在跨场景与跨传感器设置下,平均性能超越现有方法4.3%以上。
- 适合隐私敏感的遥感应用,如城市测绘、环境监测等场景使用。
三维地理空间点云语义分割是遥感应用的基础,但区域差异和采集条件变化导致的域偏移常使模型性能下降。尽管域自适应可缓解此问题,但现有方法通常需访问源域数据,而这一需求常因隐私和政策限制无法实现。为此,我们提出LoGo(局部-全局双共识)框架,一种新型无源无监督域自适应(SFUDA)方法,仅需预训练模型和未标注的目标数据。在局部层面,引入类别平衡原型估计模块,确保在尾部类别样本稀少时仍能生成鲁棒特征原型,有效缓解长尾分布引发的特征坍缩。在全局层面,设计基于最优传输的全局分布对齐模块,将伪标签分配建模为全局优化问题,纠正局部贪婪分配中头部类别的过度主导,避免模型预测严重偏向多数类。最后,提出双一致性伪标签过滤机制,仅保留局部多增强集成预测与全局最优传输分配一致的高置信度伪标签用于自训练。在两个具有挑战性的基准测试上进行的大量实验表明,LoGo在跨场景和跨传感器设置中持续优于现有最先进方法。源代码已公开于 https://github.com/GYproject/LoGo-SFUDA。
原文摘要 · Abstract (English)
Semantic segmentation of 3D geospatial point clouds is fundamental to remote sensing applications, yet domain shifts caused by regional and acquisition-related variations often degrade model performance. Although domain adaptation can mitigate such shifts, existing methods typically require access to source-domain data, which is often infeasible due to privacy concerns and regulatory policies. To address this, we propose LoGo (Local-Global Dual-Consensus), a novel source-free unsupervised domain adaptation (SFUDA) framework requiring only a pretrained model and unlabeled target data. At the local level, we introduce a class-balanced prototype estimation module that ensures that robust feature prototypes can be generated even for sample-scarce tail classes, effectively mitigating the feature collapse caused by long-tailed distributions. At the global level, we introduce an optimal transport-based global distribution alignment module that formulates pseudo-label assignment as a global optimization problem, effectively correcting the over-dominance of head classes inherent in local greedy assignments, and thereby preventing model predictions from being severely biased towards majority classes. Finally, we propose a dual-consistency pseudo-label filtering mechanism that retains only high-confidence pseudo-labels where local multi-augmented ensemble predictions align with global optimal transport assignments for self-training. Extensive experiments on two challenging benchmarks, encompassing cross-scene and cross-sensor settings, demonstrate that LoGo consistently outperforms existing state-of-the-art methods. The source code is available at https://github.com/GYproject/LoGo-SFUDA.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。