利用可靠语音片段重建病变语音,提升恢复准确性。
AP-GRPO: Anchor-Gated Phonetic Alignment with Policy Optimization for Pathological Speech Reconstruction

- 通过清晰段落中的可靠语音锚点引导重建
- 在四种疾病中均提升语音恢复准确率
- 自动适配不同疾病特征,可解释性强
神经退行性和神经运动障碍患者的声音常出现声学失真和语言碎片化,导致语音重构必要。此类录音通常并非均匀受损:部分词或短语仍清晰,可作为重构周围失真内容的可靠锚点。我们提出锚点门控音素对齐与策略优化框架(AP-GRPO),通过保留清晰区域的音频锚点及锚点间的音素相容性来对齐语音语言模型(SLMs)。AP-GRPO包含两项机制:(i) 锚点门控奖励,匹配清晰区可靠的音频锚点;(ii) 锚点间音素对齐奖励,评估恢复内容是否由对应失真段落的音素支持。在四种疾病条件下,AP-GRPO显著提升语音重构忠实度,学习到的锚点约束能自动适应各病症,揭示可解释的疾病特异性模式:严重发音障碍需更强锚点约束,而较轻度或语言功能受损者更依赖音素对齐进行锚点间恢复。
原文摘要 · Abstract (English)
Pathological speech from patients with neurodegenerative and neuromotor disorders is often acoustically distorted and linguistically fragmented, making pathological speech reconstruction necessary to recover intended textual content from distorted and incomplete speech recordings. Crucially, such recordings are rarely uniformly degraded: some words or short phrases remain reliable and can serve as audible anchors for reconstructing the corrupted surrounding content. We introduce Anchor-gated Phonetic Group Relative Policy Optimization (AP-GRPO), a GRPO framework with phonetic reward that aligns speech language models (SLMs) through audible-anchor preservation and inter-anchor phonetic compatibility to the original speech signal. AP-GRPO consists of: (i) an anchor-gated reward that matches reliable audible anchors in clear regions; and (ii) an inter-anchor phonetic alignment reward that evaluates whether recovered contents are phonetically supported by the corresponding corrupted inter-anchor speech span. Across four disease conditions, AP-GRPO improves faithful speech reconstruction, and the learned anchor constraint automatically adapts to each condition and thus reveals interpretable disease-specific profiles: conditions with severe articulatory degradation require stronger anchor enforcement, whereas milder impairment or linguistically impaired conditions rely more on phonetic alignment for inter-anchor recovery.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。