arXiv:2509.13581cs.CRcs.SD2025-09

用鼠标传感器偷听说话,无需权限就能窃取语音。

Invisible Ears at Your Fingertips: Acoustic Eavesdropping via Mouse Sensors

  • 利用鼠标传感器捕捉声音引起的微小震动实现窃听。
  • 在理想环境下语音信噪比提升19分贝,识别准确率42%至61%。
  • 无需系统权限,适合研究侧信道攻击与硬件安全的读者。

现代光学鼠标传感器凭借高精度和高响应性,存在未被重视的侧信道漏洞。本文提出Mic-E-Mouse,首个针对高性能光学鼠标传感器的隐蔽窃听攻击。我们证明音频信号可引发表面微小振动,被鼠标传感器捕获。令人惊讶的是,主流操作系统上的用户级软件可直接获取原始鼠数据,无需系统权限。初始提取的振动信号因采样不均、非线性频率响应和严重量化而质量差。为此,Mic-E-Mouse采用端到端数据过滤流程,结合维纳滤波、重采样校正及创新的仅编码器谱图神经滤波技术。我们在不同条件下评估攻击效果,包括音量、鼠标轮询率与DPI、表面材质、语言及环境噪声。在受控环境中,语音重建信噪比最高提升+19 dB。对AudioMNIST和VCTK数据集,语音识别准确率达42%至61%。所有代码与数据集已公开于https://sites.google.com/view/mic-e-mouse。

原文摘要 · Abstract (English)

Modern optical mouse sensors, with their advanced precision and high responsiveness, possess an often overlooked vulnerability: they can be exploited for side-channel attacks. This paper introduces Mic-E-Mouse, the first-ever side-channel attack that targets high-performance optical mouse sensors to covertly eavesdrop on users. We demonstrate that audio signals can induce subtle surface vibrations detectable by a mouse's optical sensor. Remarkably, user-space software on popular operating systems can collect and broadcast this sensitive side channel, granting attackers access to raw mouse data without requiring direct system-level permissions. Initially, the vibration signals extracted from mouse data are of poor quality due to non-uniform sampling, a non-linear frequency response, and significant quantization. To overcome these limitations, Mic-E-Mouse employs a sophisticated end-to-end data filtering pipeline that combines Wiener filtering, resampling corrections, and an innovative encoder-only spectrogram neural filtering technique. We evaluate the attack's efficacy across diverse conditions, including speaking volume, mouse polling rate and DPI, surface materials, speaker languages, and environmental noise. In controlled environments, Mic-E-Mouse improves the signal-to-noise ratio (SNR) by up to +19 dB for speech reconstruction. Furthermore, our results demonstrate a speech recognition accuracy of roughly 42% to 61% on the AudioMNIST and VCTK datasets. All our code and datasets are publicly accessible on https://sites.google.com/view/mic-e-mouse.

侧信道攻击语音窃听硬件安全

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。