arXiv:2602.23978cs.IR2026-02被引 9

解决检索中热门与冷门物品的量化困境,提升效率与泛化能力。

Towards Efficient and Generalizable Retrieval: Adaptive Semantic Quantization and Residual Knowledge Transfer

  • 按物品路径熵动态分配编码长度,热门项用长码区分,冷门项用短码泛化。
  • 利用热门项学习的语义流形正则化冷门项,加速训练并减少数据稀疏影响。
  • 在工业搜索系统中显著提升冷启动场景的检索效果,适合大规模推荐系统。

尽管基于语义ID的生成式检索可在工业应用中实现高效端到端建模,但此类方法始终面临权衡难题:一方面,数据丰富的热门物品常因ID冲突而模糊特征,影响下游任务;另一方面,数据稀疏的尾部物品尤其是冷启动物品在量化过程中易出现语义碎片化,被映射为孤立离散点,严重制约其泛化能力。为此,我们提出锚定课程顺序自适应量化(SA²CRQ)框架。该框架引入顺序自适应残差量化(SARQ),根据物品路径熵动态分配代码长度,为热门项分配更长、更具区分性的ID,为尾部项分配更短、更具泛化性的ID。为缓解数据稀疏问题,锚定课程残差量化(ACRQ)组件利用从热门项学习到的冻结语义流形,对尾部项的表示学习进行正则化和加速。大规模工业搜索系统及多个公开数据集的实验结果表明,SA²CRQ在现有基线基础上持续取得提升,尤其在冷启动检索场景下表现突出。

原文摘要 · Abstract (English)

While semantic ID-based generative retrieval enables efficient end-to-end modeling in industrial applications, these methods face a persistent trade-off. On one hand, data-rich head items often suffer from ID collisions, which blur their distinct features and degrade downstream tasks. On the other hand, data-sparse tail items especially cold-start items are prone to semantic fragmentation during quantization; they are often mapped as isolated discrete points, which severely hinders their ability to generalize. To address this issue, we propose the Anchored Curriculum with Sequential Adaptive Quantization ($SA^2CRQ$) framework. The framework introduces Sequential Adaptive Residual Quantization (SARQ) to dynamically allocate code lengths based on item path entropy, assigning longer, discriminative IDs to head items and shorter, generalizable IDs to tail items. To mitigate data sparsity, the Anchored Curriculum Residual Quantization (ACRQ) component utilizes a frozen semantic manifold learned from head items to regularize and accelerate the representation learning of tail items. Experimental results from a large-scale industrial search system and multiple public datasets indicate that $SA^2CRQ$ yields consistent improvements over existing baselines, particularly in cold-start retrieval scenarios.

检索系统量化冷启动工业应用

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。