arXiv:2503.14824cs.CV2025-03中稿 · IEEE TMM被引 1

通过扰动旧特征原型,缓解新模型对旧模型的强对齐约束。

Prototype Perturbation for Relaxing Alignment Constraints in Backward-Compatible Learning

  • 用扰动旧原型构建伪旧特征空间,弱化对齐约束。
  • 在地标和商品数据集上超越现有BCL方法性能。
  • 适合需要兼容旧系统又提升新模型判别力的场景。

传统检索模型更新需重新计算全量图库嵌入,即回填过程,耗时且计算密集。为避免回填,后向兼容学习(BCL)被广泛研究,旨在训练与旧模型兼容的新模型。以往工作多聚焦于强化新旧模型嵌入对齐以提升兼容性,但强对齐会削弱新模型的判别能力,尤其当不同类别在旧特征空间中紧密聚集难以区分时。为此,本文提出通过引入旧特征原型扰动来放松约束,使新特征空间与由扰动原型定义的伪旧特征空间对齐,从而在保持后向兼容性的同时保留新模型的判别能力。我们设计两种扰动计算方法:邻域驱动原型扰动(NDPP)与优化驱动原型扰动(ODPP),二者均考虑新旧模型的特征分布,随新模型更新动态调整扰动。大量实验表明,所提方法在地标和商品数据集上均优于当前最优BCL算法。

原文摘要 · Abstract (English)

The traditional paradigm to update retrieval models requires re-computing the embeddings of the gallery data, a time-consuming and computationally intensive process known as backfilling. To circumvent backfilling, Backward-Compatible Learning (BCL) has been widely explored, which aims to train a new model compatible with the old one. Many previous works focus on effectively aligning the embeddings of the new model with those of the old one to enhance the backward-compatibility. Nevertheless, such strong alignment constraints would compromise the discriminative ability of the new model, particularly when different classes are closely clustered and hard to distinguish in the old feature space. To address this issue, we propose to relax the constraints by introducing perturbations to the old feature prototypes. This allows us to align the new feature space with a pseudo-old feature space defined by these perturbed prototypes, thereby preserving the discriminative ability of the new model in backward-compatible learning. We have developed two approaches for calculating the perturbations: Neighbor-Driven Prototype Perturbation (NDPP) and Optimization-Driven Prototype Perturbation (ODPP). Particularly, they take into account the feature distributions of not only the old but also the new models to obtain proper perturbations along with new model updating. Extensive experiments on the landmark and commodity datasets demonstrate that our approaches perform favorably against state-of-the-art BCL algorithms.

后向兼容特征对齐原型扰动检索模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。