用自适应时频分析减少打击乐延时失真,音质更自然。
SELEBI: Percussion-aware Time Stretching via Selective Magnitude Spectrogram Compression by Nonstationary Gabor Transform
- 基于非平稳格伯变换动态调整窗长,实现打击乐局部化频谱分析
- 实验表明显著降低打击乐模糊,保持信号完美重建
- 适合音乐编辑、音频修复等对打击乐保真度要求高的场景
基于相位声码器的音频时间拉伸技术广泛用于音频信号的时间尺度修改。然而,传统方法存在‘打击乐模糊’这一众所周知的失真问题,严重损害打击乐成分的质量。我们将其归因于时域平滑的幅值谱与新生成的局部位相之间存在根本的时间-尺度不匹配。为解决此问题,我们提出SELEBI,一种信号自适应的相位声码器算法,显著减少打击乐模糊,同时保持稳定性和完美重建特性。不同于依赖启发式处理或成分分离的传统方法,我们的方法利用非平稳格伯变换。通过动态调整分析窗长,在含有显著能量的打击乐段落使用短窗,直接从时域信号计算出时序局部化的幅值谱。该方法确保了幅值与相位在时间结构上的更高一致性。此外,非平稳格伯变换的完美重建特性保证了稳定、高保真的信号合成,优于以往的启发式方法。实验结果表明,所提方法有效缓解打击乐模糊,获得自然音质。
原文摘要 · Abstract (English)
Phase vocoder-based time-stretching is a widely used technique for the time-scale modification of audio signals. However, conventional implementations suffer from ``percussion smearing,'' a well-known artifact that significantly degrades the quality of percussive components. We attribute this artifact to a fundamental time-scale mismatch between the temporally smeared magnitude spectrogram and the localized, newly generated phase. To address this, we propose SELEBI, a signal-adaptive phase vocoder algorithm that significantly reduces percussion smearing while preserving stability and the perfect reconstruction property. Unlike conventional methods that rely on heuristic processing or component separation, our approach leverages the nonstationary Gabor transform. By dynamically adapting analysis window lengths to assign short windows to intervals containing significant energy associated with percussive components, we directly compute a temporally localized magnitude spectrogram from the time-domain signal. This approach ensures greater consistency between the temporal structures of the magnitude and phase. Furthermore, the perfect reconstruction property of the nonstationary Gabor transform guarantees stable, high-fidelity signal synthesis, in contrast to previous heuristic approaches. Experimental results demonstrate that the proposed method effectively mitigates percussion smearing and yields natural sound quality.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。