arXiv:2605.17762cs.AI2026-05中稿 · SIGIR 2026 industr…

用神经稀疏检索提升音乐搜索的容错能力,实现毫秒级响应。

Surface-Form Neural Sparse Retrieval: Robust Fuzzy Matching for Industrial Music Search

  • 采用无推理架构与细粒度子词分词,强化表面形式鲁棒性。
  • 召回率91.4%(对比传统n-gram的57.7%),延迟几乎为零。
  • 适合高并发、低延迟的工业级音乐搜索场景。

在亚马逊音乐规模的音乐搜索中,查询常因拼写错误、音素变化等偏离索引元数据,但系统需满足毫秒级延迟要求。现有学习排序系统HCI依赖持续探索选择候选,传统n-gram匹配语义鲁棒性差且噪声高,制约长尾查询学习。本文提出一种鲁棒的神经稀疏检索系统,适配最先进的无推理稀疏检索架构,并结合领域专用细粒度子词分词策略。通过限制最大3字符的短词元约束,抑制词汇记忆,强化表面形式鲁棒性。离线阶段预计算神经嵌入与词条扩展,线上仅需极简分词与IDF加权,实现近乎零延迟的查询编码。在600万文档生产语料上评估,召回率@10达91.4%(对比n-gram的57.7%),吞吐量相当。模拟HCI反馈循环显示探索效率提升,稳定召回率提高0.8%。消融实验表明,稀疏训练方法是性能提升主因,领域预训练可替代大规模通用预训练,成本更低。

原文摘要 · Abstract (English)

Music search at the scale of Amazon Music presents a unique challenge: queries frequently deviate from indexed metadata due to misspellings, transpositions, and phonetic variations, yet the retrieval system must operate under strict millisecond-level latency constraints. Our existing learning-to-retrieve system, the High Confidence Index (HCI), learns query-entity associations from customer behavior, relying on continual ``exploration'' to choose candidates. Traditional n-gram matching enables this exploration but suffers from poor semantic robustness and high noise, limiting the system's ability to learn from long-tail queries. In this work, we present a \textbf{robust neural sparse retrieval system} designed to maximize exploration efficiency. We adapt a state-of-the-art \textbf{inference-free} sparse retrieval architecture to the music domain, combining it with an effective \textbf{domain-specific granular subword tokenization strategy}. Our approach utilizes short-length token constraints (max 3 chars) to enforce the learning of surface-form robustness over lexical memorization. By pre-computing the neural embeddings and term expansions during the offline indexing phase, online processing is reduced to minimal tokenization and IDF weighting, achieving effectively zero latency overhead for query encoding. Evaluations on a 6M-document production corpus show an aggregate \textbf{91.4\%} recall@10 (vs. \textbf{57.7\%} for trigrams) at comparable throughput. Simulation of the HCI feedback loop demonstrates improved exploration efficiency, with \textbf{+0.8\%} higher stabilized recall than production trigrams. Ablation studies indicate that our sparse training methodology drives the performance gains, while domain-specific pretraining provides a cost-effective alternative to large-scale general-purpose pretraining.

信息检索神经检索音乐搜索稀疏模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。