arXiv:2504.14280cs.CVcs.LG2025-04TPAMI综述被引 26

综述CLIP在跨域泛化与适应中的应用,助力模型应对真实场景多样性。

CLIP-Powered Domain Generalization and Domain Adaptation: A Comprehensive Survey

  • 按提示学习与特征提取两类方法,系统梳理CLIP在跨域任务中的应用
  • 涵盖有源与无源场景,分析知识迁移机制与性能提升策略
  • 指出现实挑战与未来方向,适合研究鲁棒性机器学习的学者参考

随着机器学习发展,域泛化(DG)和域适应(DA)已成为提升模型在多样化环境中的鲁棒性关键。对比语言-图像预训练(CLIP)在这些任务中发挥重要作用,具备强大零样本能力,使模型能在未见域中有效运行。然而,现有文献缺乏对CLIP在DG与DA中应用的系统性综述,凸显本调研的必要性。本文全面回顾了CLIP在DG与DA中的应用:在DG中,将方法分为优化提示学习以对齐任务需求,以及利用CLIP作为骨干进行有效特征提取;在DA中,涵盖使用标注源数据的有源方法和主要基于目标域数据的无源方法,强调知识迁移机制与性能优化策略。关键挑战如过拟合、域多样性及计算效率被深入探讨,并提出未来研究方向以推动实际应用中的鲁棒性与高效性。通过整合现有文献并识别核心空白,本综述为研究人员与实践者提供重要洞见,推动更可靠模型的发展。

原文摘要 · Abstract (English)

As machine learning evolves, domain generalization (DG) and domain adaptation (DA) have become crucial for enhancing model robustness across diverse environments. Contrastive Language-Image Pretraining (CLIP) plays a significant role in these tasks, offering powerful zero-shot capabilities that allow models to perform effectively in unseen domains. However, there remains a significant gap in the literature, as no comprehensive survey currently exists that systematically explores the applications of CLIP in DG and DA, highlighting the necessity for this review. This survey presents a comprehensive review of CLIP's applications in DG and DA. In DG, we categorize methods into optimizing prompt learning for task alignment and leveraging CLIP as a backbone for effective feature extraction, both enhancing model adaptability. For DA, we examine both source-available methods utilizing labeled source data and source-free approaches primarily based on target domain data, emphasizing knowledge transfer mechanisms and strategies for improved performance across diverse contexts. Key challenges, including overfitting, domain diversity, and computational efficiency, are addressed, alongside future research opportunities to advance robustness and efficiency in practical applications. By synthesizing existing literature and pinpointing critical gaps, this survey provides valuable insights for researchers and practitioners, proposing directions for effectively leveraging CLIP to enhance methodologies in domain generalization and adaptation. Ultimately, this work aims to foster innovation and collaboration in the quest for more resilient machine learning models that can perform reliably across diverse real-world scenarios. A more up-to-date version of the papers is maintained at: https://github.com/jindongli-Ai/Survey_on_CLIP-Powered_Domain_Generalization_and_Adaptation.

域泛化域适应CLIP综述

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。