arXiv:2603.24322cs.CV2026-03中稿 · CVPR被引 1

动态调整学习顺序,让模型在恶劣天气下更公平地学好每一类分割。

Heuristic Self-Paced Learning for Domain Adaptive Semantic Segmentation under Adverse Conditions

论文配图:Heuristic Self-Paced Learning for Domain Adaptive Semantic Segmentation under Adverse Conditions
图 1 · 摘自论文原文
  • 用强化学习思想自动决定每轮该重点学哪类图像。
  • 在三个真实数据集上达到当前最好效果,尤其在夜间和雨天表现强。
  • 适合做自动驾驶、无人机等复杂环境下的视觉分割任务。

语义类别在训练中的学习顺序显著影响无监督域自适应分割性能,尤其在恶劣天气条件下。现有方法多依赖人工设计的启发式规则(如固定不确定度指标)并采用静态调度,难以适应模型随训练演化的高维动态过程,导致类别偏见。受强化学习启发,我们将课程学习建模为序列决策问题,提出一个自主的类别调度器。该调度器包含两个组件:(i) 高维状态编码器,将模型训练状态映射到潜在空间并提炼出反映进展的关键特征;(ii) 类别公平的策略梯度目标,确保各类别均衡提升。结合源-目标混合监督,所学出的类别排序能引导网络在每个阶段聚焦最具有信息量的类别,实现更自适应、动态的学习。值得注意的是,本方法在三个广泛使用的基准(ACDC、Dark Zurich、Nighttime Driving)上取得当前最优性能,并展现出从合成到真实场景的泛化能力。

原文摘要 · Abstract (English)

The learning order of semantic classes significantly impacts unsupervised domain adaptation for semantic segmentation, especially under adverse weather conditions. Most existing curricula rely on handcrafted heuristics (e.g., fixed uncertainty metrics) and follow a static schedule, which fails to adapt to a model's evolving, high-dimensional training dynamics, leading to category bias. Inspired by Reinforcement Learning, we cast curriculum learning as a sequential decision problem and propose an autonomous class scheduler. This scheduler consists of two components: (i) a high-dimensional state encoder that maps the model's training status into a latent space and distills key features indicative of progress, and (ii) a category-fair policy-gradient objective that ensures balanced improvement across classes. Coupled with mixed source-target supervision, the learned class rankings direct the network's focus to the most informative classes at each stage, enabling more adaptive and dynamic learning. It is worth noting that our method achieves state-of-the-art performance on three widely used benchmarks (e.g., ACDC, Dark Zurich, and Nighttime Driving) and shows generalization ability in synthetic-to-real semantic segmentation.

语义分割域自适应强化学习恶劣天气

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。