arXiv:2507.01143cs.ROcs.LG2025-07综述被引 15

聚焦机器人场景,梳理深度学习在声源定位中的最新进展。

A Review on Sound Source Localization in Robotics: Focusing on Deep Learning Methods

  • 以机器人应用为视角,系统梳理经典与深度学习方法
  • 强调数据与训练策略对模型性能的关键作用
  • 适合从事机器人听觉感知与智能算法的研究者

声源定位(SSL)为听觉感知增加空间维度,使系统能够精确定位语音、机械噪声、警报声等声学事件的来源,从而支持机器人导航、人机对话及设备状态监测。现有综述多关注通用音频应用,未充分考虑机器人约束或深度学习最新进展。本文针对此不足,提供面向机器人的综合评述,重点分析深度学习方法的最新成果。首先回顾时差法(TDOA)、波束成形、定向响应功率(SRP)、子空间分析等经典方法;随后深入探讨传统机器学习、神经网络(NNs)、卷积神经网络(CNNs)、卷积循环神经网络(CRNNs)及新兴注意力架构。重点分析深度学习方法的数据与训练策略,并按机器人类型和应用领域分类研究工作,帮助研究者快速定位相关成果。最后指出当前普遍挑战:环境鲁棒性、多声源干扰、机器人实现约束,以及深度学习中的数据与学习策略问题,并提出有前景的研究方向,为下一代高效、可解释、适应性强的深度学习声源定位提供行动路线图。

原文摘要 · Abstract (English)

Sound source localization (SSL) adds a spatial dimension to auditory perception, allowing a system to pinpoint the origin of speech, machinery noise, warning tones, or other acoustic events, capabilities that facilitate robot navigation, human-machine dialogue, and condition monitoring. While existing surveys provide valuable historical context, they typically address general audio applications and do not fully account for robotic constraints or the latest advancements in deep learning. This review addresses these gaps by offering a robotics-focused synthesis, emphasizing recent progress in deep learning methodologies. We start by reviewing classical methods such as Time Difference of Arrival (TDOA), beamforming, Steered-Response Power (SRP), and subspace analysis. Subsequently, we delve into modern machine learning (ML) and deep learning (DL) approaches, discussing traditional ML and neural networks (NNs), convolutional neural networks (CNNs), convolutional recurrent neural networks (CRNNs), and emerging attention-based architectures. The data and training strategy that are the two cornerstones of DL-based SSL are explored. Studies are further categorized by robot types and application domains to facilitate researchers in identifying relevant work for their specific contexts. Finally, we highlight the current challenges in SSL works in general, regarding environmental robustness, sound source multiplicity, and specific implementation constraints in robotics, as well as data and learning strategies in DL-based SSL. Also, we sketch promising directions to offer an actionable roadmap toward robust, adaptable, efficient, and explainable DL-based SSL for next-generation robots.

声源定位机器人感知深度学习综述

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。