arXiv:2609.02376cs.SDcs.CR2026-09

用合成数据训练的模型,从环境音频中移除语音却保留活动信息。

Removing Speech, Keeping Activities: A Privacy Firewall for Acoustic Sensing in Assisted Living

论文配图:Removing Speech, Keeping Activities: A Privacy Firewall for Acoustic Sensing in Assisted Living
图 1 · 摘自论文原文
  • 基于U-Net的隐私防火墙,仅用合成数据训练,可分离语音与环境声。
  • 在ESC-50上实现0%语音检测残留,优于现有方法36%以上。
  • 真实家庭录音中无语音残留,活动识别精度仍达76%。

声学感知为监测老年人日常活动提供了一种非侵入式方案,但语音隐私问题仍是实际部署的关键障碍。本文提出一种基于U-Net编码器-解码器的隐私防火墙流水线,完全使用合成数据训练,可在移除语音的同时保留指示日常活动的环境声音。活动识别采用VGGish迁移学习结合SVM分类器。在ESC-50和SINS数据集上,多语音含量条件下,该模型将残留语音降至0%(使用Silero语音活动检测),优于Facebook Denoiser(6.55%)、SepFormer(36.34%)和ConvTasNet(47.21%)。在ESC-50 40%语音水平下,语音去除后分类精度与召回率恢复至85%和85%,优于去除前的81%/75%及无语音基线的84%/83%。在真实家庭录音(AudioHive应用采集)上,处理后语音检测率为0%,同时保持76%的精度与召回率。该流水线在不牺牲活动识别性能的前提下实现隐私保护,解决了老年照护中环境监测推广的核心障碍。

原文摘要 · Abstract (English)

Acoustic sensing offers a promising non-intrusive approach for monitoring daily activities of older adults, yet speech privacy concerns remain a critical barrier to real-world deployment. We present a privacy firewall pipeline based on a U-Net encoder-decoder, trained entirely on synthetic data, that removes speech from ambient audio while preserving environmental sounds indicative of daily activities. Activity recognition is performed using VGGish transfer learning with an SVM classifier. Evaluated on the ESC-50 and SINS datasets across multiple speech content levels, the proposed model reduced residual speech to 0% VAD-detectable speech (Silero Voice Activity Detection) under all tested conditions, outperforming Facebook Denoiser (6.55% residual), SepFormer (36.34%) and ConvTasNet (47.21%) on ESC-50 at the 100\% speech level. On ESC-50 at 40% speech level, classification performance recovers to 85% precision and 85% recall after speech removal, compared with 81%/75% before removal and an 84%/83% speech-free baseline. Evaluation on real-world participant home recordings collected with the AudioHive app showed 0% VAD-detectable speech after processing while maintaining 76% precision and recall. The pipeline enables privacy-preserving acoustic sensing without sacrificing activity recognition performance, addressing a key obstacle to the adoption of ambient monitoring in elderly care.

隐私保护声学传感老年照护语音分离

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。