解决无源域泛化中多类别风格生成效率低的问题。
BatStyler: Advancing Multi-category Style Generation for Source-free Domain Generalization
- 分两阶段生成粗粒度语义与均匀分布风格模板,提升多样性。
- 在多类别数据集上超越现有方法,性能显著提升。
- 适合需要高效跨域泛化的工业级视觉系统应用。
无源域泛化(SFDG)旨在不依赖源域数据的情况下构建可在未见域上表现良好的模型。然而,由于缺乏训练数据,其实现仍受限。现有研究聚焦于多模态模型的知识迁移与联合空间中的风格合成,以消除对源域图像的依赖。但多数方法仅适用于少类别场景,在多类别配置下性能较差,且风格合成效率下降。如何高效生成足够多样化的数据并应用于多类别配置,具有更高的实际价值。本文提出BatStyler方法,通过两个模块——粗粒度语义生成与均匀风格生成——分别防止多类别配置下风格空间压缩,并实现风格模板的均匀分布与并行训练。大量实验表明,该方法在少类别数据集上表现相当,而在多类别数据集上显著优于当前最优方法。
原文摘要 · Abstract (English)
Source-Free Domain Generalization (SFDG) aims to develop a model that performs on unseen domains without relying on any source domains. However, the implementation remains constrained due to the unavailability of training data. Research on SFDG focus on knowledge transfer of multi-modal models and style synthesis based on joint space of multiple modalities, thus eliminating the dependency on source domain images. However, existing works primarily work for multi-domain and less-category configuration, but performance on multi-domain and multi-category configuration is relatively poor. In addition, the efficiency of style synthesis also deteriorates in multi-category scenarios. How to efficiently synthesize sufficiently diverse data and apply it to multi-category configuration is a direction with greater practical value. In this paper, we propose a method called BatStyler, which is utilized to improve the capability of style synthesis in multi-category scenarios. BatStyler consists of two modules: Coarse Semantic Generation and Uniform Style Generation modules. The Coarse Semantic Generation module extracts coarse-grained semantics to prevent the compression of space for style diversity learning in multi-category configuration, while the Uniform Style Generation module provides a template of styles that are uniformly distributed in space and implements parallel training. Extensive experiments demonstrate that our method exhibits comparable performance on less-category datasets, while surpassing state-of-the-art methods on multi-category datasets.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。