arXiv:2412.11819cs.CV2024-12中稿 · AAAI被引 24

构建分层图网络,同时捕捉图像局部与类别全局特征,提升半监督领域自适应性能。

HiGDA: Hierarchical Graph of Nodes to Learn Local-to-Global Topology for Semi-Supervised Domain Adaptation

  • 设计分层节点图,分别建模图像局部块和类别间关系。
  • 在Office-Home、DomainNet等数据集上达到新最佳性能。
  • 适合关注跨域图像分类与表征学习的研究者。

深度学习模型虽具备强大的表征能力与广泛应用前景,但在领域偏移场景下表现不佳——训练数据(源域)与测试数据(目标域)分布不同。为应对这一挑战,已有研究通过引入少量目标域有标签样本进行半监督领域自适应(SSDA),有效提升了分类性能。然而,现有方法多聚焦单个图像的特征提取,难以充分挖掘复杂表示。本文提出分层节点图(HiGDA),在特征层面构建局部图以识别图像内最相关图像块,增强对主对象的表征适应性;在类别层面构建全局图,聚合同类别样本特征,丰富整体表示。在Office-Home、DomainNet及VisDA2017等主流SSDA基准数据集上的大量实验表明,本方法在定量与定性结果上均显著优于现有方法,成为新的最优方案。

原文摘要 · Abstract (English)

The enhanced representational power and broad applicability of deep learning models have attracted significant interest from the research community in recent years. However, these models often struggle to perform effectively under domain shift conditions, where the training data (the source domain) is related to but exhibits different distributions from the testing data (the target domain). To address this challenge, previous studies have attempted to reduce the domain gap between source and target data by incorporating a few labeled target samples during training - a technique known as semi-supervised domain adaptation (SSDA). While this strategy has demonstrated notable improvements in classification performance, the network architectures used in these approaches primarily focus on exploiting the features of individual images, leaving room for improvement in capturing rich representations. In this study, we introduce a Hierarchical Graph of Nodes designed to simultaneously present representations at both feature and category levels. At the feature level, we introduce a local graph to identify the most relevant patches within an image, facilitating adaptability to defined main object representations. At the category level, we employ a global graph to aggregate the features from samples within the same category, thereby enriching overall representations. Extensive experiments on widely used SSDA benchmark datasets, including Office-Home, DomainNet, and VisDA2017, demonstrate that both quantitative and qualitative results substantiate the effectiveness of HiGDA, establishing it as a new state-of-the-art method.

领域自适应图神经网络半监督学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。