无需训练即可精细控制语音情感与语速,让合成更自然
TED-TTS: Training-Free Intra-Utterance Emotion and Duration Control for Text-to-Speech Synthesis
- 用分段感知策略分离情感控制与语义,实现平滑情感切换
- 通过局部时长调节与全局终止控制,保持语句整体连贯性
- 自动生成提示词,避免人工标注,适合快速部署到任意语音模型
尽管可控语音合成已取得显著进展,但多数方法仍局限于跨句子级控制,难以实现细粒度的句内情感与语速调节,且依赖非公开数据或复杂多阶段训练。本文提出TED-TTS,一种面向预训练零样本语音合成的无训练句内情感与时长控制框架。我们设计了分段感知的情感条件策略,结合因果掩码与单调流对齐过滤,隔离情感控制并调度掩码过渡,实现平滑的句内情感转换同时保持全局语义连贯性。在此基础上,进一步提出分段感知的时长调控策略,结合局部时长嵌入引导与全局结束标记(EOS)logit调制,支持局部时长调整的同时确保全局终止一致性。为消除对分段级人工提示工程的需求,我们构建了一个包含30,000条样本的多情感与时长标注文本数据集,支持大语言模型自动构造提示。大量实验表明,该无训练方法在多情感与时长控制上达到当前最佳句内一致性表现,同时保持底层语音合成模型的基础语音质量。代码与音频样例已公开。
原文摘要 · Abstract (English)
While controllable Text-to-Speech (TTS) has achieved notable progress, most existing methods remain limited to inter-utterance-level control, making fine-grained intra-utterance expression challenging due to their reliance on non-public datasets or complex multi-stage training. In this paper, we propose TED-TTS, a training-free controllable framework for pretrained zero-shot TTS to enable intra-utterance emotion and duration expression. Specifically, we propose a segment-aware emotion conditioning strategy that combines causal masking with monotonic stream alignment filtering to isolate emotion conditioning and schedule mask transitions, enabling smooth intra-utterance emotion shifts while preserving global semantic coherence. Based on this, we further propose a segment-aware duration steering strategy to combine local duration embedding steering with global EOS logit modulation, allowing local duration adjustment while ensuring globally consistent termination. To eliminate the need for segment-level manual prompt engineering, we construct a 30,000-sample multi-emotion and duration-annotated text dataset to enable LLM-based automatic prompt construction. Extensive experiments demonstrate that our training-free method not only achieves state-of-the-art intra-utterance consistency in multi-emotion and duration control, but also maintains baseline-level speech quality of the underlying TTS model. Code and audio samples are available.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。