arXiv:2601.17086cs.SDcs.AI2026-01被引 3

无需重训,一键修正大模型语音合成中生僻词的发音错误。

SonoEdit: Null-Space Constrained Knowledge Editing for Pronunciation Correction in LLM-Based TTS

  • 基于空域约束编辑,单次更新参数即可修正特定词汇发音。
  • 在保留原有语音生成能力的前提下,精准调整目标词发音。
  • 适合需要快速适配多语言场景的语音合成系统部署者。

神经文本转语音(TTS)系统因训练语料以英语为主,常对低资源专有名词(如非英语人名、品牌、地名)产生误读。现有方法依赖昂贵的多语数据收集、监督微调或人工音素标注,限制了TTS在语言多样场景中的应用。本文提出SonoEdit,一种无需重训练的模型编辑技术,通过空域发音编辑实现精准纠错。首先利用声学因果追踪定位负责文本到发音映射的Transformer层,再施加空域约束编辑,计算闭式权重更新,修正目标发音同时保持与其他语音行为的数学正交性。该更新使模型输出趋近指定发音示例,且对保留语音语料的输出无一阶变化,确保整体语音质量不受影响。

原文摘要 · Abstract (English)

Neural text-to-speech (TTS) systems systematically mispronounce low-resource proper nouns, particularly non-English names, brands, and geographic locations, due to their underrepresentation in predominantly English training corpora. Existing solutions typically rely on expensive multilingual data collection, supervised finetuning, or manual phonetic annotation, which limits the deployment of TTS systems in linguistically diverse settings. We introduce SonoEdit, a model editing technique that surgically corrects pronunciation errors in pre-trained TTS models without retraining. Instead of costly finetuning or explicit phoneme injection, we propose a parsimonious alternative based on Null-Space Pronunciation Editing, which performs a single-shot parameter update to modify the pronunciation of specific words while provably preserving all other model behavior. We first adapt Acoustic Causal Tracing to identify the Transformer layers responsible for text-to-pronunciation mapping. We then apply Null-Space Constrained Editing to compute a closed-form weight update that corrects the target pronunciation while remaining mathematically orthogonal to the subspace governing general speech generation. This constrained update steers the model's acoustic output toward a desired pronunciation exemplar while guaranteeing zero first-order change on a preserved speech corpus.

语音合成模型编辑发音纠错

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。