通过原型对齐实现跨域检索的语义一致性,提升哈希编码质量。
Prototype-Based Semantic Consistency Alignment for Domain Adaptive Retrieval
- 用正交原型建立类别级语义关联,增强类间分离性。
- 基于几何邻近度自适应加权伪标签置信度,提升可靠性。
- 重建特征后量化,生成统一跨域二进制哈希码,适合跨域检索场景。
跨域检索旨在将有标签源域的知识迁移至无标签目标域,实现有效检索并缓解域差异。现有方法存在三大局限:1)忽视类别级语义对齐,过度追求样本对级对齐;2)缺乏伪标签可靠性考量或几何引导以评估标签正确性;3)直接对受域偏移影响的原始特征进行量化,损害哈希码质量。针对这些问题,我们提出原型基语义一致性对齐(PSCA),一种两阶段框架。第一阶段通过一组正交原型直接建立类别级语义连接,最大化类间可分性并聚集类内样本。原型学习过程中,几何邻近度提供语义一致性对齐的可靠性指标,通过自适应加权伪标签置信度。由此产生的成员矩阵与原型支持特征重建,确保在重建特征上而非原始特征上进行量化,从而提升后续哈希编码质量,并无缝衔接两阶段。第二阶段,领域特定量化函数在相互近似约束下处理重建特征,生成跨域统一的二进制哈希码。大量实验验证了PSCA在多个数据集上的优越性能。
原文摘要 · Abstract (English)
Domain adaptive retrieval aims to transfer knowledge from a labeled source domain to an unlabeled target domain, enabling effective retrieval while mitigating domain discrepancies. However, existing methods encounter several fundamental limitations: 1) neglecting class-level semantic alignment and excessively pursuing pair-wise sample alignment; 2) lacking either pseudo-label reliability consideration or geometric guidance for assessing label correctness; 3) directly quantizing original features affected by domain shift, undermining the quality of learned hash codes. In view of these limitations, we propose Prototype-Based Semantic Consistency Alignment (PSCA), a two-stage framework for effective domain adaptive retrieval. In the first stage, a set of orthogonal prototypes directly establishes class-level semantic connections, maximizing inter-class separability while gathering intra-class samples. During the prototype learning, geometric proximity provides a reliability indicator for semantic consistency alignment through adaptive weighting of pseudo-label confidences. The resulting membership matrix and prototypes facilitate feature reconstruction, ensuring quantization on reconstructed rather than original features, thereby improving subsequent hash coding quality and seamlessly connecting both stages. In the second stage, domain-specific quantization functions process the reconstructed features under mutual approximation constraints, generating unified binary hash codes across domains. Extensive experiments validate PSCA's superior performance across multiple datasets.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。