提出PD-Loss,让度量学习更高效且分布更可分。
PD-Loss: Proxy-Decidability for Efficient Metric Learning
- 用可学习的代理点结合决策指数优化嵌入空间
- 在细粒度分类和人脸识别上达到顶尖性能
- 适合需要高效、可扩展度量学习的研究者
深度度量学习旨在学习嵌入函数,使语义相似的输入在度量空间中靠近,而语义不同者远离。现有方法如成对损失受复杂采样和收敛慢限制;代理损失虽具可扩展性,但难以优化全局分布。基于可决性指数(d')的D-Loss虽提升分布可分性,却需大批次导致计算开销高。本文提出代理-可决性损失(PD-Loss),将可学习代理点与d'的统计框架结合,通过代理估计真实与虚假样本分布,实现计算高效与分布可分性的统一,支持可扩展的分布感知度量学习。在细粒度分类与人脸验证等任务上,性能媲美最先进方法,为嵌入优化提供新视角,具备广泛适用潜力。
原文摘要 · Abstract (English)
Deep Metric Learning (DML) aims to learn embedding functions that map semantically similar inputs to proximate points in a metric space while separating dissimilar ones. Existing methods, such as pairwise losses, are hindered by complex sampling requirements and slow convergence. In contrast, proxy-based losses, despite their improved scalability, often fail to optimize global distribution properties. The Decidability-based Loss (D-Loss) addresses this by targeting the decidability index (d') to enhance distribution separability, but its reliance on large mini-batches imposes significant computational constraints. We introduce Proxy-Decidability Loss (PD-Loss), a novel objective that integrates learnable proxies with the statistical framework of d' to optimize embedding spaces efficiently. By estimating genuine and impostor distributions through proxies, PD-Loss combines the computational efficiency of proxy-based methods with the principled separability of D-Loss, offering a scalable approach to distribution-aware DML. Experiments across various tasks, including fine-grained classification and face verification, demonstrate that PD-Loss achieves performance comparable to that of state-of-the-art methods while introducing a new perspective on embedding optimization, with potential for broader applications.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。