解决跨域数据特征与类别不一致的问题,能识别新类别。
Open-Set Heterogeneous Domain Adaptation: Theoretical Analysis and Algorithm
- 构建理论框架,指导跨异构域的模型学习
- 在文本、图像和临床数据上实现高精度识别新类别
- 适合处理现实场景中未知类别的迁移学习任务
领域自适应(DA)通过从源域学习模型来缓解目标域的分布偏移问题。然而,现有大多数方法仅适用于源域与目标域共享相同特征空间的情况,限制了其在真实场景中的应用。近年来,异构领域自适应(HeDA)方法被提出以应对源域与目标域特征空间不一致的挑战。尽管取得一定成功,当前的HeDA技术在特征空间和标签空间均存在差异时仍表现不足。为此,本文提出一种新的领域自适应场景——开放集异构域自适应(OSHeDA),要求模型不仅处理特征空间异构,还需识别属于新类别的样本。为此,我们首先建立一个全新的理论框架,推导出目标域预测误差的泛化界。基于该框架,我们提出一种名为RL-OSHeDA的新算法,可同时实现异构数据源间的知识迁移与新类别识别。在文本、图像及临床数据上的实验验证了该算法的有效性。模型代码已公开于https://github.com/pth1993/OSHeDA。
原文摘要 · Abstract (English)
Domain adaptation (DA) tackles the issue of distribution shift by learning a model from a source domain that generalizes to a target domain. However, most existing DA methods are designed for scenarios where the source and target domain data lie within the same feature space, which limits their applicability in real-world situations. Recently, heterogeneous DA (HeDA) methods have been introduced to address the challenges posed by heterogeneous feature space between source and target domains. Despite their successes, current HeDA techniques fall short when there is a mismatch in both feature and label spaces. To address this, this paper explores a new DA scenario called open-set HeDA (OSHeDA). In OSHeDA, the model must not only handle heterogeneity in feature space but also identify samples belonging to novel classes. To tackle this challenge, we first develop a novel theoretical framework that constructs learning bounds for prediction error on target domain. Guided by this framework, we propose a new DA method called Representation Learning for OSHeDA (RL-OSHeDA). This method is designed to simultaneously transfer knowledge between heterogeneous data sources and identify novel classes. Experiments across text, image, and clinical data demonstrate the effectiveness of our algorithm. Model implementation is available at \url{https://github.com/pth1993/OSHeDA}.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。