通过融合邻域投影与排名学习,提升图像检索的精准度。
Aggregating Neighbor Embedding Projection and Rank-Based Manifold Learning for Image Retrieval

- 用UMAP生成低维特征,结合排名列表进行融合
- 在多个数据集上提升最高排名结果的准确率
- 适合处理特征表达弱时的图像检索任务
基于内容的图像检索(CBIR)虽因深度学习取得显著进展,但在高维特征空间中有效排序相似图像仍具挑战,因成对距离难以捕捉上下文关系,且视觉特征与高层语义间存在语义鸿沟。流形学习与基于排名的优化方法分别改善特征表示和利用排名列表中的邻近关系等上下文信息。然而,如何结合投影型与排名型策略仍属难题。本文提出一种结合邻域嵌入投影与基于排名的流形学习的框架,通过排名聚合实现融合:使用均匀流形逼近与投影(UMAP)生成替代低维表示,并采用博达计数法聚合来自UMAP投影与基于排名重排序方法的排名列表。实验在多个公开数据集上进行,使用ResNet152、Swin Transformer及DINOv2提取深度特征。结果表明,该方法在基准表示性能较差时尤其有效,显著提升检索效果,尤其改善了前排结果质量,各项指标如平均精度均值(MAP)和精确率表现优异,证明通过排名聚合融合两类流形学习策略可为图像检索提供互补的上下文信息。
原文摘要 · Abstract (English)
Content-based image retrieval (CBIR) has advanced significantly with deep learning, yet effectively ranking similar images remains challenging, particularly in high-dimensional feature spaces, where pairwise distances often fail to capture contextual relationships and the semantic gap between visual features and high-level concepts persists. Manifold learning and rank-based refinement methods have emerged as complementary strategies, respectively improving feature representations and exploiting contextual information embedded in ranked lists, such as neighborhood relationships among images. However, combining these projection-based and rank-based strategies to exploit their complementary properties remains a challenging research problem. To address this, we propose a framework that combines neighbor embedding projections with rank-based manifold learning through rank aggregation. Uniform Manifold Approximation and Projection (UMAP) generates alternative low-dimensional feature representations, and ranked lists obtained from UMAP projections and rank-based re-ranking methods are combined using the Borda Count aggregation strategy. Experiments were conducted on several public datasets using deep learning features extracted from ResNet152, Swin Transformer, and DINOv2 models. Results show that the proposed approach improves retrieval effectiveness in several scenarios, particularly when the baseline representation struggles to achieve high precision. The aggregation strategy also often improves the quality of top-ranked positions, leading to competitive Mean Average Precision (MAP) and Precision values across different datasets and feature extractors. These findings suggest that combining projection-based and rank-based manifold learning strategies through rank aggregation can provide complementary contextual information for image retrieval tasks.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。