轻量模型E2PANNs实现高精度实时应急车辆警报检测
From Large-scale Audio Tagging to Real-Time Explainable Emergency Vehicle Sirens Detection
- 基于PANNs改进的轻量卷积网络,专为警报声二分类设计
- 在多个数据集上达到新SOTA,边缘设备推理延迟低于50ms
- 支持可解释性分析,适合智能交通与自动驾驶等安全场景
准确识别应急车辆警报对智能交通、智慧城市监控和自动驾驶至关重要。现有自动解决方案受限于缺乏大规模标注数据集及先进声音事件检测模型的高计算开销。本文提出E2PANNs(高效应急预训练音频神经网络),一种从PANNs框架衍生的轻量级卷积神经网络,专门优化用于二元应急车辆警报检测。利用自建的AudioSet子集(AudioSet EV)进行微调与评估,并在多个参考数据集上测试其在嵌入式硬件上的可行性。实验包括消融研究、跨域基准测试及边缘设备实时推理部署。通过引导反向传播和ScoreCAM算法进行可解释性分析,揭示模型内部表征,验证其能捕捉不同类型应急车辆警报的独特时频特征。实时性能通过帧级与事件级检测指标,以及误触发详细分析评估。结果表明,E2PANNs在该领域建立新SOTA,具备高计算效率,适用于基于边缘的音频监控与安全关键应用。
原文摘要 · Abstract (English)
Accurate recognition of Emergency Vehicle (EV) sirens is critical for the integration of intelligent transportation systems, smart city monitoring systems, and autonomous driving technologies. Modern automatic solutions are limited by the lack of large scale, curated datasets and by the computational demands of state of the art sound event detection models. This work introduces E2PANNs (Efficient Emergency Pre trained Audio Neural Networks), a lightweight Convolutional Neural Network architecture derived from the PANNs framework, specifically optimized for binary EV siren detection. Leveraging our dedicated subset of AudioSet (AudioSet EV) we fine-tune and evaluate E2PANNs across multiple reference datasets and test its viability on embedded hardware. The experimental campaign includes ablation studies, cross-domain benchmarking, and real-time inference deployment on edge device. Interpretability analyses exploiting Guided Backpropagation and ScoreCAM algorithms provide insights into the model internal representations and validate its ability to capture distinct spectrotemporal patterns associated with different types of EV sirens. Real time performance is assessed through frame wise and event based detection metrics, as well as a detailed analysis of false positive activations. Results demonstrate that E2PANNs establish a new state of the art in this research domain, with high computational efficiency, and suitability for edge-based audio monitoring and safety-critical applications.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。