通过行为与语言模式无监督检测信息操作用户,提升识别准确率。
Unsupervised Anomaly Detection of Information Operations Users via Behavioral and Language Patterns
- 结合时间行为与文本内容,用时序点过程捕捉异常模式。
- 在5个真实数据集上优于基线方法,显著提升检测效果。
- 适合反虚假信息、社交媒体安全研究者使用。
社交网络中的信息操作对民主与现代社会构成重大威胁,但人工检测成本高且难度大。现有监督方法难以应对信息操作用户行为的动态演变,而无监督方法常依赖用户协同的简化假设,现实中未必成立。为此,本文将信息操作用户检测建模为异常检测问题,提出一种新型无监督方法TENSOR,融合时间行为(如发帖活动)与文本内容多模态数据。由于信息操作用户通常占比极小且具独特的时间行为与语言模式,TENSOR首先训练时序点过程(TPP)以捕捉其异常行为;进一步设计新颖证据函数,将大模型对用户发帖时间线的响应转化为量化评分,优化TPP输出。实验表明,TENSOR在五个真实世界信息操作数据集上均优于基线方法。代码已开源:https://github.com/xiuzhenzhang/TENSOR。
原文摘要 · Abstract (English)
Information Operations on social media networks have been identified as a significant threat to democracy and modern society, but they are challenging and expensive to detect by humans. Existing supervised IO detection methods fail to capture the dynamic nature of evolving IO user behavior, while existing unsupervised approaches rely on oversimplified assumptions of coordination among IO users that may not exist in practice. To overcome the limitations of existing methods, we formulate IO user detection as an anomaly detection problem and propose a novel unsupervised IO user detection approach called Temporal-bEhavior-laNguage Signals for information Operation Recognition (TENSOR), which leverages multimodal data, including temporal online user behavior, such as message posting activities, and the textual content of the messages. The motivation is that IO users are typically a very small fraction of all online users and have unique temporal behavioral and language patterns. Specifically, we train a Temporal Point Process (TPP) to capture abnormal temporal behavioral patterns of IO users because they are known to behave in a coordinated manner for IO campaigns. We further introduce a novel evidence function that converts LLM responses, which are generated from user post timelines, into quantitative scores to adjust the TPP outputs for better IO user detection. Experimental results show that TENSOR outperforms the baselines on five real-world IO datasets. Code is available at https://github.com/xiuzhenzhang/TENSOR.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。