arXiv:2505.24115cs.SDcs.HC2025-05被引 2

保护语音感应中的用户性别年龄隐私,兼顾实用性和安全性

FeatureSense: Protecting Speaker Attributes in Always-On Audio Sensing System

  • 提出可通用的隐私感知音频特征,防止说话人属性泄露
  • 在多种任务中保持高识别精度,隐私保护提升60.6%
  • 适合需隐私保护的智能音箱、手机等始终在线音频系统

音频是一种丰富的感知模态,广泛用于人类活动识别。然而,智能手机和智能音箱等设备的始终在线麦克风引发了严重的隐私担忧,导致用户信任度下降。本文针对音频感知应用中用户隐私保护的关键挑战,在保持实用性的同时提出解决方案。现有工作主要关注语音内容的保护,但我们发现即使屏蔽语音,仍可推断出年龄、性别等敏感说话人属性,并构建了全面的隐私评估框架以量化此类属性泄露风险。为此,我们设计并实现了 FeatureSense——一个开源库,提供一组可泛化的隐私感知音频特征,适用于多种感知任务。提出自适应任务特异性特征选择算法,根据应用需求优化隐私-效用-成本平衡。通过大量实验验证,FeatureSense 在多样化传感任务中表现出高实用性,其隐私保护能力相比现有技术提升60.6%。本工作为建立可信音频感知系统提供了基础框架。

原文摘要 · Abstract (English)

Audio is a rich sensing modality that is useful for a variety of human activity recognition tasks. However, the ubiquitous nature of smartphones and smart speakers with always-on microphones has led to numerous privacy concerns and a lack of trust in deploying these audio-based sensing systems. This paper addresses this critical challenge of preserving user privacy when using audio for sensing applications while maintaining utility. While prior work focuses primarily on protecting recoverable speech content, we show that sensitive speaker-specific attributes such as age and gender can still be inferred after masking speech and propose a comprehensive privacy evaluation framework to assess this speaker attribute leakage. We design and implement FeatureSense, an open-source library that provides a set of generalizable privacy-aware audio features that can be used for wide range of sensing applications. We present an adaptive task-specific feature selection algorithm that optimizes the privacy-utility-cost trade-off based on the application requirements. Through our extensive evaluation, we demonstrate the high utility of FeatureSense across a diverse set of sensing tasks. Our system outperforms existing privacy techniques by 60.6% in preserving user-specific privacy. This work provides a foundational framework for ensuring trust in audio sensing by enabling effective privacy-aware audio classification systems.

隐私保护音频感知特征工程

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。