通过语义与行为模式联合分析,精准识别大模型生成的社交机器人。
TRACE-Bot: Detecting Emerging LLM-Driven Social Bots via Implicit Semantic Representations and AIGC-Enhanced Behavioral Patterns
- 构建双通道框架,融合语言语义与行为异常特征。
- 在两个数据集上达到98.46%和97.50%的检测准确率。
- 适合关注AI内容安全与虚假信息治理的研究者。
大型语言模型驱动的社交机器人正通过生成类人内容威胁在线舆论环境,传统检测方法因依赖单一模态信号、对AI生成内容(AIGC)特征敏感度不足,以及未能充分建模语言与行为动态关系而效果有限。为此,本文提出TRACE-Bot,一种统一的双通道框架,联合建模隐式语义表征与AIGC增强的行为模式。该框架从个人资料、互动行为和推文等异构数据源中构建细粒度表征,采用预训练语言模型捕捉语言特征,并结合先进AIGC检测器提供的信号,增强多维活动特征以识别行为异常。最终通过轻量级分类头进行判别。在两个公开的LLM驱动社交机器人数据集上的实验表明,本方法达到98.46%和97.50%的准确率,展现出对高级机器人策略的强鲁棒性,验证了联合利用隐式语义与AIGC增强行为模式在新兴社交机器人检测中的有效性。
原文摘要 · Abstract (English)
Large Language Model-driven (LLM-driven) social bots pose a growing threat to online discourse by generating human-like content that evades conventional detection. Existing methods suffer from limited detection accuracy due to overreliance on single-modality signals, insufficient sensitivity to the specific generative patterns of Artificial Intelligence-Generated Content (AIGC), and a failure to adequately model the interplay between linguistic patterns and behavioral dynamics. To address these limitations, we propose TRACE-Bot, a unified dual-channel framework that jointly models implicit semantic representations and AIGC-enhanced behavioral patterns. TRACE-Bot constructs fine-grained representations from heterogeneous sources, including personal information data, interaction behavior data and tweet data. A dual-channel architecture captures linguistic representations via a pretrained language model and behavioral irregularities via multidimensional activity features augmented with signals from state-of-the-art (SOTA) AIGC detectors. The fused representations are then classified through a lightweight prediction head. Experiments on two public LLM-driven social bot datasets demonstrate SOTA performance, achieving accuracies of 98.46% and 97.50%, respectively. The results further indicate strong robustness against advanced bot strategies, highlighting the effectiveness of jointly leveraging implicit semantic representations and AIGC-enhanced behavioral patterns for emerging LLM-driven social bot detection.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。