arXiv:2503.22038cs.MAcs.CL2025-03中稿 · the 13th Internati…被引 12

用多智能体辩论提升钓鱼邮件识别准确率

Debate-Driven Multi-Agent LLMs for Phishing Email Detection

  • 两个智能体分别辩护正反方,裁判评估推理质量
  • 混合配置比同质配置表现更优,准确率显著提升
  • 无需额外提示策略,辩论结构本身即有效

钓鱼攻击仍是重大网络安全威胁。传统检测方法如规则系统和监督学习模型,要么依赖黑名单等预定义模式,易被微小修改绕过;要么需大量训练数据,仍会产生误报与漏报。本文提出一种多智能体大语言模型提示技术,模拟智能体间辩论以判断邮件内容是否为钓鱼邮件。该方法使用两个智能体分别支持或反对分类任务,由裁判智能体根据推理质量作出最终裁决。辩论机制使模型能深入分析文本中的上下文线索与欺骗模式,从而提升分类准确性。在多个钓鱼邮件数据集上的评估表明,混合配置始终优于同质配置。结果还显示,辩论结构本身已足够实现高精度判断,无需额外提示策略。

原文摘要 · Abstract (English)

Phishing attacks remain a critical cybersecurity threat. Attackers constantly refine their methods, making phishing emails harder to detect. Traditional detection methods, including rule-based systems and supervised machine learning models, either rely on predefined patterns like blacklists, which can be bypassed with slight modifications, or require large datasets for training and still can generate false positives and false negatives. In this work, we propose a multi-agent large language model (LLM) prompting technique that simulates debates among agents to detect whether the content presented on an email is phishing. Our approach uses two LLM agents to present arguments for or against the classification task, with a judge agent adjudicating the final verdict based on the quality of reasoning provided. This debate mechanism enables the models to critically analyze contextual cue and deceptive patterns in text, which leads to improved classification accuracy. The proposed framework is evaluated on multiple phishing email datasets and demonstrate that mixed-agent configurations consistently outperform homogeneous configurations. Results also show that the debate structure itself is sufficient to yield accurate decisions without extra prompting strategies.

钓鱼邮件多智能体LLM应用

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。