提出自适应域调度器,提升开放集域泛化性能。
Advancing Open-Set Domain Generalization Using Evidential Bi-Level Hardest Domain Scheduler
- 基于证据理论构建双层最难域调度策略
- 在多个数据集上显著提升未见类识别准确率
- 适合需要应对未知类别和域变化的场景
在开放集域泛化(OSDG)中,模型需同时处理数据分布的新变化(域)和测试时存在已知与未知类别的开放集条件。该任务的挑战在于跨域泛化与类别新颖性量化双重需求,对动态环境应用至关重要。近期元学习方法通过设计随机类别和预定义域划分,在元训练与元测试间有效协同,优于传统依赖数据增强和特征判别力提升的方法。现有主流模型多采用预设顺序域调度器,但其调度策略对训练效果的影响尚未充分探索。本文发现自适应域调度更优,提出证据论双层最难域调度器(EBiL-HaDS),通过跟随网络评估域可靠性,利用证据学习的置信度、最大偏差修正正则化,并以双层优化方式实现自适应调度。实验表明,该方法显著提升OSDG性能,增强了对已见与未见类别的可分性表征。源代码已公开于 https://github.com/KPeng9510/EBiL-HaDS。
原文摘要 · Abstract (English)
In Open-Set Domain Generalization (OSDG), the model is exposed to both new variations of data appearance (domains) and open-set conditions, where both known and novel categories are present at test time. The challenges of this task arise from the dual need to generalize across diverse domains and accurately quantify category novelty, which is critical for applications in dynamic environments. Recently, meta-learning techniques have demonstrated superior results in OSDG, effectively orchestrating the meta-train and -test tasks by employing varied random categories and predefined domain partition strategies. These approaches prioritize a well-designed training schedule over traditional methods that focus primarily on data augmentation and the enhancement of discriminative feature learning. The prevailing meta-learning models in OSDG typically utilize a predefined sequential domain scheduler to structure data partitions. However, a crucial aspect that remains inadequately explored is the influence brought by strategies of domain schedulers during training. In this paper, we observe that an adaptive domain scheduler benefits more in OSDG compared with prefixed sequential and random domain schedulers. We propose the Evidential Bi-Level Hardest Domain Scheduler (EBiL-HaDS) to achieve an adaptive domain scheduler. This method strategically sequences domains by assessing their reliabilities in utilizing a follower network, trained with confidence scores learned in an evidential manner, regularized by max rebiasing discrepancy, and optimized in a bi-level manner. The results show that our method substantially improves OSDG performance and achieves more discriminative embeddings for both the seen and unseen categories. The source code is publicly available at https://github.com/KPeng9510/EBiL-HaDS.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。