用生成式AI提升用户安全检测,覆盖诈骗、恶意软件等多领域
Gen-AI for User Safety: A Survey
- 利用生成式AI理解语言上下文,突破传统模型局限
- 支持文本、图像、音频等多模态数据的违规行为识别
- 适合安全研究者和平台风控团队参考
机器学习与数据挖掘技术广泛用于检测用户安全违规行为,如识别垃圾邮件或钓鱼网页。然而,现有模型在理解自然语言的语境与细微差别方面能力有限。生成式AI(Gen-AI)凭借其跨语言翻译、多任务迁移与领域适配能力,有效克服了上述挑战。本文系统综述了生成式AI在用户安全领域的应用,涵盖钓鱼攻击、恶意软件、内容审核、假冒产品及物理安全等多个场景。重点分析了生成式AI如何结合文本、图像、视频、音频及可执行二进制文件等多模态数据进行违规检测,并探讨其在对抗环境中的应用。本工作首次全面总结了生成式AI在用户安全中的进展,为后续研究提供基础框架。
原文摘要 · Abstract (English)
Machine Learning and data mining techniques (i.e. supervised and unsupervised techniques) are used across domains to detect user safety violations. Examples include classifiers used to detect whether an email is spam or a web-page is requesting bank login information. However, existing ML/DM classifiers are limited in their ability to understand natural languages w.r.t the context and nuances. The aforementioned challenges are overcome with the arrival of Gen-AI techniques, along with their inherent ability w.r.t translation between languages, fine-tuning between various tasks and domains. In this manuscript, we provide a comprehensive overview of the various work done while using Gen-AI techniques w.r.t user safety. In particular, we first provide the various domains (e.g. phishing, malware, content moderation, counterfeit, physical safety) across which Gen-AI techniques have been applied. Next, we provide how Gen-AI techniques can be used in conjunction with various data modalities i.e. text, images, videos, audio, executable binaries to detect violations of user-safety. Further, also provide an overview of how Gen-AI techniques can be used in an adversarial setting. We believe that this work represents the first summarization of Gen-AI techniques for user-safety.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。