用隐私保护理论重新审视语音匿名化评估标准的缺陷
In Defense of Using Worst-case Privacy Disclosure as Privacy Evaluation Metric of Voice Anonymization
- 以香农完美保密为基准，分析传统EER指标的局限性
- 揭示理想EER表现仍可能泄露个体说话人信息
- 证明排名指标可转化为符合完美保密原则的度量
语音匿名化领域主要使用等错误率（EER）评估语音身份保护性能。尽管已有隐私-ZEBRA和基于排名的度量等替代方案提出，但其底层假设与差异对新手而言仍不清晰。本文旨在填补这一空白。基于香农完美保密（或隐私）概念，本文捍卫隐私-ZEBRA框架。虽未提出新度量，但阐明了在EER上表现理想的系统仍可能在对数似然比（LLR）空间中泄露个体说话人信息。本文还展示了如何将排名指标转化为遵循完美保密原则的度量，并证明两者最优解等价。此外，文章解释了LLR估计方法对评估结果的影响。这些讨论在现有文献中尚未被充分探讨。最后，实验在模拟数据和VoicePrivacy Challenge数据上验证了结论。
原文摘要 · Abstract (English)
The voice anonymization community mainly uses Equal Error Rate (EER) to evaluate the performance of voice identity protection. While alternative metrics such as privacy-ZEBRA and a rank-based metric have been proposed, their underlying assumptions and differences may not be well known, especially to newcomers. This paper is motivated to fill the gap. Based on the concept of Shannon's perfect secrecy (or privacy), this paper positions itself as a defense of the privacy-ZEBRA framework. While no new metric is proposed, this paper explains how an `ideal' system in terms of EER may fail to gauge the information leakage on individual speakers in the log-likelihood ratio (LLR) space. The paper also shows how the rank-based metric can be cast into a metric that follows the same principle of perfect secrecy and how their best solutions are equivalent. Furthermore, the paper explains how the method of estimating LLRs may affect the evaluation results. These discussions are, to the best of the authors' knowledge, not explored or explained in detail in existing papers. Last but not least, the findings are demonstrated on simulated and VoicePrivacy Challenge data.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品；中文卡片由大模型生成，请以原文为准。