arXiv:2411.07517eess.SPcs.SD2024-11中稿 · WACV 2025被引 1

提出联合去噪与轮廓分割的声场图像处理方法,提升声学成像清晰度。

SoundSil-DS: Deep Denoising and Segmentation of Sound-field Images with Silhouettes

  • 基于先进去噪网络,联合优化声场与物体轮廓的去噪和分割
  • 在仿真与实测数据上均实现有效降噪并准确分离声场与轮廓
  • 适用于自动驾驶与机器人声学感知的后处理,助力三维重建

光学技术的发展使二维(2D)声场成像成为可能,该声光传感技术有助于理解声波与物体间的相互作用,如反射和衍射。此外,它有望作为自动驾驶车辆和辅助机器人声呐的先进测量手段。然而,声光传感的声压敏感度低,导致图像噪声强度高,因此去噪是可视化与分析声场的关键任务。除去噪外,还需对声场与物体轮廓进行分割,以分析其相互作用。本文提出声场图像中带物体轮廓的去噪与分割方法(SoundSil-DS),在可视化图像上联合执行声场与物体轮廓的去噪与分割。我们基于当前最先进的去噪网络构建新模型,并通过声学仿真创建训练与评估数据集。所提方法在仿真与实测数据上均进行了评估,结果表明其可应用于实验测量数据。这些结果表明,该方法可改善声场的后处理,例如基于物理模型的三维重建,因其能有效去除噪声并分离声场与其他物体轮廓。代码已开源:https://github.com/nttcslab/soundsil-ds。

原文摘要 · Abstract (English)

Development of optical technology has enabled imaging of two-dimensional (2D) sound fields. This acousto-optic sensing enables understanding of the interaction between sound and objects such as reflection and diffraction. Moreover, it is expected to be used an advanced measurement technology for sonars in self-driving vehicles and assistive robots. However, the low sound-pressure sensitivity of the acousto-optic sensing results in high intensity of noise on images. Therefore, denoising is an essential task to visualize and analyze the sound fields. In addition to denoising, segmentation of sound and object silhouette is also required to analyze interactions between them. In this paper, we propose sound-field-images-with-object-silhouette denoising and segmentation (SoundSil-DS) that jointly perform denoising and segmentation for sound fields and object silhouettes on a visualized image. We developed a new model based on the current state-of-the-art denoising network. We also created a dataset to train and evaluate the proposed method through acoustic simulation. The proposed method was evaluated using both simulated and measured data. We confirmed that our method can applied to experimentally measured data. These results suggest that the proposed method may improve the post-processing for sound fields, such as physical model-based three-dimensional reconstruction since it can remove unwanted noise and separate sound fields and other object silhouettes. Our code is available at https://github.com/nttcslab/soundsil-ds.

声场成像去噪分割声光传感三维重建

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。