用PyTorch和GPU加速,让音频信号处理更高效灵活。
TorchFX: A modern approach to Audio DSP with PyTorch and GPU acceleration
- 基于PyTorch构建,支持多通道音频的FIR与IIR滤波器
- 相比SciPy在多通道场景下效率显著提升
- 适合需要融合AI与音频处理的研究者和开发者
音频信号日益复杂且对实时处理要求高,亟需利用GPU计算能力优化算法。现有数字信号处理(DSP)库在效率和灵活性上不足,尤其难以集成人工智能(AI)模型。为此,我们提出TorchFX:一个基于PyTorch的GPU加速音频信号处理库,提供类torchaudio的面向对象接口,并引入新颖的管道操作符实现滤波器链式调用。该库涵盖完整的有限冲激响应(FIR)与无限冲激响应(IIR)滤波器,重点支持多通道音频文件,促进传统DSP与AI方法的融合。基准测试显示,在多通道场景下,其性能显著优于SciPy等传统库。尽管当前尚有部分GPU兼容性限制,后续开发将拓展支持并实现真正实时处理。TorchFX已开源,项目地址为https://github.com/matteospanio/torchfx。
原文摘要 · Abstract (English)
The burgeoning complexity and real-time processing demands of audio signals necessitate optimized algorithms that harness the computational prowess of Graphics Processing Units (GPUs). Existing Digital Signal Processing (DSP) libraries often fall short in delivering the requisite efficiency and flexibility, particularly in integrating Artificial Intelligence (AI) models. In response, we introduce TorchFX: a GPU-accelerated Python library for DSP, specifically engineered to facilitate sophisticated audio signal processing. Built atop the PyTorch framework, TorchFX offers an Object-Oriented interface that emulates the usability of torchaudio, enhancing functionality with a novel pipe operator for intuitive filter chaining. This library provides a comprehensive suite of Finite Impulse Response (FIR) and Infinite Impulse Response (IIR) filters, with a focus on multichannel audio files, thus facilitating the integration of DSP and AI-based approaches. Our benchmarking results demonstrate significant efficiency gains over traditional libraries like SciPy, particularly in multichannel contexts. Despite current limitations in GPU compatibility, ongoing developments promise broader support and real-time processing capabilities. TorchFX aims to become a useful tool for the community, contributing to innovation and progress in DSP with GPU acceleration. TorchFX is publicly available on GitHub at https://github.com/matteospanio/torchfx.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。