仅靠键盘敲击声就能还原输入内容,无需设备标签数据。
Transforming Keystroke Noise to Text: Self-Supervised Acoustic Eavesdropping Attacks on Keyboards

- 用自监督方法结合聚类与Transformer模型,不依赖标注数据。
- 手机近距离录音仅需100-150次按键,准确率超99%。
- 适用于远程、隔墙、会议等真实场景,适合安全研究者关注。
我们提出一种自监督声学窃听攻击,仅通过键盘敲击声音重建输入文本,无需目标设备的标注数据。该方法在物理空间(公共/半公共)和在线会议中均适用。结合无监督声学聚类、基于Transformer的语言模型推理及迭代自训练,可在高度不确定的声学到字符映射下实现稳定字符推断。实验表明,在手机近距离放置于目标设备旁的条件下,仅需100-150次敲击即可实现超过99%的重建准确率,显著优于先前无监督基线。进一步评估显示,在多款笔记本平台及真实采集场景(如同桌3米远距离录音、穿墙接触麦克风、在线会议背景键盘噪声)中,约150-250次敲击即可达到90%以上准确率。结果表明,在仅音频条件下,高精度文本重建已具备现实可行性,且无需设备特异性标注数据,揭示了一种此前被低估的真实隐私风险。
原文摘要 · Abstract (English)
We present a self-supervised acoustic eavesdropping attack that reconstructs typed text solely from keystroke sounds, without requiring labeled data for the target device. The proposed attack enables stealthy eavesdropping in two real-world scenarios-physical spaces (public and semi-public) and online meetings. Our method combines unsupervised acoustic clustering with Transformer-based language model inference and iterative self-training, enabling stable character inference under highly uncertain acoustic-to-character mappings. We demonstrate that the proposed method achieves over 99% reconstruction accuracy with only 100-150 observed keystrokes under a close-proximity recording setup using a smartphone placed near the target device, significantly outperforming prior unsupervised baselines in low-data regimes. We further evaluate robustness across multiple laptop platforms and in realistic acquisition channels, including distance recording from approximately 3 meters away on the same desk, through-the-wall eavesdropping with a contact microphone, and background keyboard noise in online conferencing systems. Across these scenarios, the proposed method achieves high reconstruction accuracy (often exceeding 90%) with approximately 150-250 observed keystrokes. These results indicate that accurate text reconstruction from keystroke sounds is feasible in practice under an audio-only setting, even with limited observed keystrokes and without requiring device-specific labeled data, highlighting a realistic and previously underestimated privacy risk.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。