arXiv:2409.13793cs.CRcs.AI2024-09被引 14

AI可自动实施诈骗电话,骗出敏感信息

On the Feasibility of Fully AI-automated Vishing Attacks

  • 用大模型+语音转换实现自动化骗术对话
  • 240人实验中多人被骗,警告后仍失守
  • 演示工具可作安全教育,也警示风险

语音诈骗(vishing)是攻击者通过电话欺骗受害者泄露个人信息、财务数据或账号凭证的社交工程手段。此类攻击利用语音交流的紧迫感和真实感,常伪装成银行或技术支持等可信机构。本文研究人工智能推动下语音诈骗自动化的可行性。我们构建了名为ViKing的全AI语音诈骗系统,基于公开可用的AI技术,以大语言模型(LLM)为核心决策模块,配合语音转文本与文本转语音模块完成通话交互。在包含240名参与者的受控社会实验中,ViKing成功诱导多人披露敏感信息,即使这些参与者已被告知语音诈骗风险。多数对话被评价为真实自然。结果表明,类似ViKing的工具可能已被恶意行为者获取,同时可作为网络安全意识教育的重要资源。

原文摘要 · Abstract (English)

A vishing attack is a form of social engineering where attackers use phone calls to deceive individuals into disclosing sensitive information, such as personal data, financial information, or security credentials. Attackers exploit the perceived urgency and authenticity of voice communication to manipulate victims, often posing as legitimate entities like banks or tech support. Vishing is a particularly serious threat as it bypasses security controls designed to protect information. In this work, we study the potential for vishing attacks to escalate with the advent of AI. In theory, AI-powered software bots may have the ability to automate these attacks by initiating conversations with potential victims via phone calls and deceiving them into disclosing sensitive information. To validate this thesis, we introduce ViKing, an AI-powered vishing system developed using publicly available AI technology. It relies on a Large Language Model (LLM) as its core cognitive processor to steer conversations with victims, complemented by a pipeline of speech-to-text and text-to-speech modules that facilitate audio-text conversion in phone calls. Through a controlled social experiment involving 240 participants, we discovered that ViKing has successfully persuaded many participants to reveal sensitive information, even those who had been explicitly warned about the risk of vishing campaigns. Interactions with ViKing's bots were generally considered realistic. From these findings, we conclude that tools like ViKing may already be accessible to potential malicious actors, while also serving as an invaluable resource for cyber awareness programs.

语音诈骗AI安全社会工程

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。