AudioNet用深度哈希实现高效音频事件检索,精度超现有方法。
AudioNet: Supervised Deep Hashing for Retrieval of Similar Audio Events
- 设计带加权对比损失的深度网络,生成相似音频的二进制哈希码。
- 在多个标准数据集上达到新基准,即使在数据不平衡时仍表现稳定。
- 首次系统评估相似音频事件检索性能,适合音频检索与嵌入研究者。
本文提出一种用于检索相似音频事件的监督式深度哈希方法——AudioNet。该方法基于深度学习,通过输入音频示例实现高效哈希与检索。AudioNet在多个标准数据集上生成相似音频事件的二进制哈希码,显著提升检索性能,创下新基准。研究提出一种融合加权对比损失与加权成对损失的新型损失函数,并引入哈希码平衡机制。通过离散梯度传播技术,使梯度可反向传播至离散变量,从而支持使用标准梯度优化算法优化哈希码。实验表明,该方法在多种数据集上均表现优异,尤其在数据不平衡情况下仍具鲁棒性。系统性分析进一步验证了其在多数据集上的显著优势,为未来基于深度音频嵌入的相似音频事件检索研究提供了基准。
原文摘要 · Abstract (English)
This work presents a supervised deep hashing method for retrieving similar audio events. The proposed method, named AudioNet, is a deep-learning-based system for efficient hashing and retrieval of similar audio events using an audio example as a query. AudioNet achieves high retrieval performance on multiple standard datasets by generating binary hash codes for similar audio events, setting new benchmarks in the field, and highlighting its efficacy and effectiveness compare to other hashing methods. Through comprehensive experiments on standard datasets, our research represents a pioneering effort in evaluating the retrieval performance of similar audio events. A novel loss function is proposed which incorporates weighted contrastive and weighted pairwise loss along with hashcode balancing to improve the efficiency of audio event retrieval. The method adopts discrete gradient propagation, which allows gradients to be propagated through discrete variables during backpropagation. This enables the network to optimize the discrete hash codes using standard gradient-based optimization algorithms, which are typically used for continuous variables. The proposed method showcases promising retrieval performance, as evidenced by the experimental results, even when dealing with imbalanced datasets. The systematic analysis conducted in this study further supports the significant benefits of the proposed method in retrieval performance across multiple datasets. The findings presented in this work establish a baseline for future studies on the efficient retrieval of similar audio events using deep audio embeddings.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。