通过预训练与数据增强,提升声学无人机检测在不同环境下的泛化能力。
Improving acoustic drone detection generalization through pretraining and data augmentation
- 先用大规模音频数据预训练,再微调于多源无人机音频数据。
- 在跨域数据上实现超过90%的检出率,距离最远达150米。
- 适合需部署于复杂真实场景的无人机安防系统开发者。
未经授权的无人机飞行监测对安保与空域管理至关重要。基于无人机螺旋桨和电机声音的声学检测提供了一种低成本、无需视线的被动解决方案。核心挑战在于泛化能力:在未见过的录音设备、环境及无人机类型下,仍能可靠区分无人机信号与背景噪声(即域外情况)。受大规模音频预训练进展启发,本文开发了一个轻量级深度神经网络检测器,并通过两项策略提升其泛化性能:(1) 先在广泛的声音事件分类任务上预训练模型,再在自建及公开的无人机音频数据上微调;(2) 实时应用多种数据增强技术,包括音高变换、噪声混合、麦克风传递函数模拟与频谱增强,使模型暴露于多样化声学条件。消融实验证明了各增强方法的影响。评估中设定符合实际监控需求的误报率目标,报告在域内数据(IDMT Berne 2022)与域外数据(AuDroK)上的真阳性率(TPR)。结果表明,预训练是实现鲁棒检测的关键因素,在所有基准测试中均显著优于从零训练。完整的增强链在声学不匹配的域外数据上带来额外增益,在AuDroK子集上取得最高平均TPR,且在最具挑战性场景中提升最大。进一步通过在非无人机公开语料库(IDMT-TRAFFIC与ESC-50)上测量误报率,验证了其在陌生背景下的低误报表现。对IDMT Berne 2022的数据进行距离依赖分析显示,检测有效范围可达150米。
原文摘要 · Abstract (English)
Detecting unauthorized UAV flights is critical for surveillance, security, and airspace management. Acoustic drone detection, which relies on the distinctive propeller and motor sounds of UAVs, provides a low-cost, passive solution that requires no line of sight. A central challenge is generalization: reliably distinguishing drone signatures from ambient noise across unseen recording setups, environments, and UAV types (out-of-domain). Inspired by advances in large-scale audio pretraining, we develop a compact DNN-based detector and improve its generalization by (1) pretraining the model for broad sound-event classification before fine-tuning on diverse in-house and public drone recordings, and (2) applying on-the-fly augmentations (pitch shifting, noise mixing, microphone transfer function simulation, spectrogram augmentation) to expose the model to varied acoustic conditions. An ablation study quantifies the impact of each augmentation. For evaluation, we set target false-positive rates (FPR) aligned with real-world surveillance needs and report true-positive rates (TPR) on both in-domain data (public IDMT Berne 2022) and out-of-domain data (public AuDroK). Our results show that pretraining is the dominant factor for robust detection, yielding substantial TPR improvements over training from scratch on all benchmarks. The full augmentation chain provides additional gains on acoustically mismatched out-of-domain data, achieving the best mean TPR on the AuDroK subsets and the largest improvements on the most challenging scenarios. We further validate real-world applicability by measuring false positives on public non-drone corpora (IDMT-TRAFFIC and ESC-50), demonstrating equally low FPR on unfamiliar backgrounds. A distance-dependent analysis on IDMT Berne 2022 shows effective detection at distances up to 150 m.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。