教大学生听语音伪造的特征,能提升辨识能力。
Listening for Expert Identified Linguistic Features: Assessment of Audio Deepfake Discernment among Undergraduate Students
- 用专家定义的语言特征训练学生听音辨假。
- 264名学生参与,训练后不确定率显著下降。
- 适合关注语音安全与媒体素养教育的人看。
本文评估了通过引导本科生关注专家定义的语言特征,来提升其识别语音深度伪造能力的效果。这类特征已被证明可提升人工智能算法的表现,但其是否同样能增强人类听众的感知与辨识能力尚不明确。鉴于人类是网络安全中最薄弱的环节,我们提出听众的辨识力是提升音频内容可信度的关键。本研究聚焦于本科生群体,因其频繁接触社交媒体,易受网络欺骗与虚假信息影响。通过前/后测实验设计,对马里兰大学巴尔的摩县分校264名学生进行实验组与对照组对比,结果显示实验组在评估音频片段时的不确定感显著降低,且对原本不确定的片段识别准确率提高。尽管结果积极,未来研究将探索更系统、全面的训练方案以增强效果。
原文摘要 · Abstract (English)
This paper evaluates the impact of training undergraduate students to improve their audio deepfake discernment ability by listening for expert-defined linguistic features. Such features have been shown to improve performance of AI algorithms; here, we ascertain whether this improvement in AI algorithms also translates to improvement of the perceptual awareness and discernment ability of listeners. With humans as the weakest link in any cybersecurity solution, we propose that listener discernment is a key factor for improving trustworthiness of audio content. In this study we determine whether training that familiarizes listeners with English language variation can improve their abilities to discern audio deepfakes. We focus on undergraduate students, as this demographic group is constantly exposed to social media and the potential for deception and misinformation online. To the best of our knowledge, our work is the first study to uniquely address English audio deepfake discernment through such techniques. Our research goes beyond informational training by introducing targeted linguistic cues to listeners as a deepfake discernment mechanism, via a training module. In a pre-/post- experimental design, we evaluated the impact of the training across 264 students as a representative cross section of all students at the University of Maryland, Baltimore County, and across experimental and control sections. Findings show that the experimental group showed a statistically significant decrease in their unsurety when evaluating audio clips and an improvement in their ability to correctly identify clips they were initially unsure about. While results are promising, future research will explore more robust and comprehensive trainings for greater impact.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。