arXiv:2502.18495cs.MMcs.AI2025-02综述被引 33

综述图像组合检索技术,梳理120+论文方法与数据集

A Comprehensive Survey on Composed Image Retrieval

  • 按细粒度分类监督与零样本检索模型
  • 对比多个数据集上120+方法的实验结果
  • 适合计算机视觉与多模态研究者参考

组合图像检索(CIR)是一项新兴且具有挑战性的任务,允许用户通过包含参考图像和修改文本的多模态查询来搜索目标图像。该任务在学术和实际应用中均有重要意义,近年来在计算机视觉与机器学习领域迅速兴起,尤其得益于深度学习的发展。据我们所知,目前尚无对CIR领域的全面综述。为此,本文综合分析了来自ACM TOIS、SIGIR、CVPR等顶级会议与期刊的120余篇文献,系统地对现有监督式与零样本式CIR模型进行了细粒度分类。此外,还简要讨论了与CIR密切相关的任务,如基于属性的检索与对话式检索。本文总结了常用基准数据集,并通过跨多个数据集的实验结果对比,分析了现有监督与零样本方法。最后,展望了未来可能的研究方向,为相关研究者提供实用参考。相关工作整理维护于 https://github.com/haokunwen/Awesome-Composed-Image-Retrieval。

原文摘要 · Abstract (English)

Composed Image Retrieval (CIR) is an emerging yet challenging task that allows users to search for target images using a multimodal query, comprising a reference image and a modification text specifying the user's desired changes to the reference image. Given its significant academic and practical value, CIR has become a rapidly growing area of interest in the computer vision and machine learning communities, particularly with the advances in deep learning. To the best of our knowledge, there is currently no comprehensive review of CIR to provide a timely overview of this field. Therefore, we synthesize insights from over 120 publications in top conferences and journals, including ACM TOIS, SIGIR, and CVPR In particular, we systematically categorize existing supervised CIR and zero-shot CIR models using a fine-grained taxonomy. For a comprehensive review, we also briefly discuss approaches for tasks closely related to CIR, such as attribute-based CIR and dialog-based CIR. Additionally, we summarize benchmark datasets for evaluation and analyze existing supervised and zero-shot CIR methods by comparing experimental results across multiple datasets. Furthermore, we present promising future directions in this field, offering practical insights for researchers interested in further exploration. The curated collection of related works is maintained and continuously updated in https://github.com/haokunwen/Awesome-Composed-Image-Retrieval.

图像检索多模态综述

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。