arXiv:2412.12863cs.CLcs.AI2024-12ACL被引 2

用字形发音相似性提升中文拼写检查准确率

DISC: Plug-and-Play Decoding Intervention with Similarity of Characters for Chinese Spelling Check

  • 推理阶段引入字形与发音相似度干预
  • 在三个基准上接近或超越当前最先进模型
  • 可无缝接入多种现有模型无需额外训练

中文拼写检查的关键特征是错误字通常在发音或字形上与正确字相似。以往方法依赖混淆集,但存在难以确定包含哪些字对、且缺乏概率区分集内项目的问题。本文提出轻量级的DISC(基于字符相似性的解码干预)模块,仅在推理阶段计算字符间的语音和字形相似度,并融入解码过程。该方法可无损集成至ReaLiSe、SCOPE、ReLM等多种现有模型,无需额外训练成本。在三个中文拼写检查基准上的实验表明,所提方法显著提升模型性能,达到甚至超过当前最先进水平。

原文摘要 · Abstract (English)

One key characteristic of the Chinese spelling check (CSC) task is that incorrect characters are usually similar to the correct ones in either phonetics or glyph. To accommodate this, previous works usually leverage confusion sets, which suffer from two problems, i.e., difficulty in determining which character pairs to include and lack of probabilities to distinguish items in the set. In this paper, we propose a light-weight plug-and-play DISC (i.e., decoding intervention with similarity of characters) module for CSC models.DISC measures phonetic and glyph similarities between characters and incorporates this similarity information only during the inference phase. This method can be easily integrated into various existing CSC models, such as ReaLiSe, SCOPE, and ReLM, without additional training costs. Experiments on three CSC benchmarks demonstrate that our proposed method significantly improves model performance, approaching and even surpassing the current state-of-the-art models.

拼写检查中文NLP解码干预相似性建模

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。