arXiv:2609.04262cs.SDcs.LG2026-09

针对日语音乐搜索错别字,用轻量模型实现毫秒级纠错。

Low-Latency Spell Correction for Japanese Music Search Queries

  • 基于BART的轻量模型,结合脚本感知的合成错误数据生成。
  • 精确匹配率达41.09%,字符错误率仅11.62%,低于所有基线。
  • 适合需要实时纠错的日语音乐搜索系统,尤其处理混合脚本查询。

日语搜索查询的拼写纠错因四种书写系统(拉丁/罗马字、平假名、片假名、汉字)共存及各自特有的错误模式而面临独特挑战。本文提出一个轻量级BART序列到序列模型(3编码层+3解码层),专为低延迟日语音乐搜索查询纠错设计。核心贡献在于一种脚本感知的合成错别字生成流程,通过结合键盘布局模型(QWERTY与滑动输入)、从真实查询日志中挖掘的语音混淆先验、清浊辅音交替以及假名大小写错误,生成真实训练数据。关键设计是将混合脚本的目录标题归一化为单一标准脚本后再进行错别字合成,有效减少模型幻觉。我们还针对目标音乐目录自定义训练了一个字节级BPE分词器,统一处理四种脚本。在精心构建的评估集上,模型达到41.09%的精确匹配率和11.62%的字符错误率(CER),优于编辑距离基线,并在所有评估系统中保持最低的CER;单张GPU推理延迟低于4毫秒。进一步的消融研究分析了各脚本及混合脚本查询的表现,验证了脚本感知数据增强的有效性。

原文摘要 · Abstract (English)

Spell correction for Japanese search queries presents unique challenges due to the co-existence of four writing scripts (Latin/romaji, hiragana, katakana, and kanji) and the distinct error patterns each script induces. We present a compact BART-based sequence-to-sequence model (3 encoder + 3 decoder layers) designed for low-latency spell correction of Japanese music search queries. The core contribution lies in a script-aware synthetic misspelling generation pipeline that produces realistic training data by combining keyboard-layout models (QWERTY and flick input), phonetic confusion priors mined from real query logs, voiced/unvoiced consonant alternations, and kana case errors. A key design decision is normalizing mixed-script catalog titles to a single canonical script before misspelling synthesis, which we show is critical for reducing model hallucinations. We train a custom byte-level BPE tokenizer on the target music catalog to handle all four scripts in a unified vocabulary. Experiments on a curated evaluation set show that our model achieves an exact-match accuracy of 41.09% and a character error rate (CER) of 11.62%, outperforming edit-distance baselines and achieving the lowest character error rate among all evaluated systems while maintaining sub-4ms inference latency on a single GPU. We further analyze performance across individual scripts and mixed-script queries, demonstrating the effectiveness of script-aware data augmentation through systematic ablation studies.

拼写纠错日语处理低延迟音乐搜索

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。