用固定d-单形分类器学稳定表征,实现模型更新时的无缝兼容。
A Stationary (and Therefore Compatible) Representation is All You Need

- 用d-单形固定分类器结合交叉熵与对比损失,学习稳定表征。
- 在模型持续微调和替换场景下,性能优于现有方法。
- 适合需要连续服务的场景,如实时检索系统。
学习兼容表征的目标是获得可在模型更新时互换使用的特征表示。本文证明,通过d-单形固定分类器学习的平稳表征符合兼容性的严格定义。该结果为后续研究奠定基础,并可直接应用于实际学习场景。针对模型序列微调时学习兼容性的挑战,我们发现使用d-单形固定分类器并采用交叉熵损失可对齐特征分布的一阶统计量,但无法充分捕捉更新间的高阶依赖。为此,我们提出将交叉熵损失与对比损失进行凸组合训练,不仅能捕获高阶依赖,且等价于在兼容性约束下的交叉熵学习。我们在新场景(预训练模型被周期性替换为更优模型)中进行了广泛实验,验证了平稳表征可在不重新处理图库图像的情况下维持不间断检索服务,同时提升模型更新与替换时的性能,达到当前最优水平。代码见https://github.com/miccunifi/iamcl2r。
原文摘要 · Abstract (English)
Learning compatible representations aims to learn feature representations that can be used interchangeably over time whenever a model undergoes updates. In this paper, we demonstrate that stationary representations learned by d-Simplex fixed classifiers imply compatibility as in its formal definition. This result establishes a foundation for future works and can be directly exploited in practical learning scenarios. We address the challenge of learning compatibility using $d$-Simplex fixed classifiers when the model is sequentially fine-tuned. Learning according to a d-Simplex fixed classifier with the cross-entropy loss aligns feature distributions at the first-order statistics. Consequently, it may not fully capture higher-order dependencies in the representation between model updates. To address this issue, we demonstrate that training the model using a $d$-Simplex fixed classifier through a convex combination of the cross-entropy loss and a contrastive loss not only captures higher-order dependencies, but is also equivalent to learning with the cross-entropy under the compatibility constraints. We confirm our findings with extensive experiments also considering a new scenario where a pre-trained model is sequentially fine-tuned and occasionally replaced with an improved model. We show that stationary representations enable uninterrupted retrieval services (without reprocessing gallery images) while improving performance during model updates and replacements, achieving state-of-the-art. Code at https://github.com/miccunifi/iamcl2r.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。