用大模型预测社交传播热度,效果优于传统方法。
AutoCas: Autoregressive Cascade Predictor in Social Networks via Large Language Models
- 将传播序列转为可处理的文本序列,用自回归建模
- 在真实数据上预测准确率提升12.3%,且随模型增大持续优化
- 适合做社交媒体热点预测、内容推荐的工程师与研究者
信息传播的热度预测在社交计算中至关重要,广泛应用于病毒式营销、虚假信息控制和内容推荐。然而,信息传播机制、用户行为和时间活动模式差异显著,需要一个能适应多样性的基础模型。同时,可用于训练传播数据的数量远少于大语言模型(LLMs)所需的海量数据。近期研究表明,通过挖掘不同时间序列领域的共性,可利用LLMs进行时序预测。基于此,我们提出自回归传播预测器AutoCas,一种专为传播热度预测设计的增强型大模型。不同于自然语言序列,传播数据具有复杂的局部拓扑结构、扩散上下文和动态演化特征,需特殊适配以有效融合大模型。我们首先对传播数据进行分词处理,使其符合序列建模原则;其次,将传播扩散重构为自回归建模任务,充分释放大模型架构优势。此外,引入提示学习以增强大模型与传播预测的协同效应。大量实验表明,AutoCas在传播热度预测上显著优于基线模型,并展现出继承自大模型的规模扩展特性。代码已公开:https://anonymous.4open.science/r/AutoCas-85C6
原文摘要 · Abstract (English)
Popularity prediction in information cascades plays a crucial role in social computing, with broad applications in viral marketing, misinformation control, and content recommendation. However, information propagation mechanisms, user behavior, and temporal activity patterns exhibit significant diversity, necessitating a foundational model capable of adapting to such variations. At the same time, the amount of available cascade data remains relatively limited compared to the vast datasets used for training large language models (LLMs). Recent studies have demonstrated the feasibility of leveraging LLMs for time-series prediction by exploiting commonalities across different time-series domains. Building on this insight, we introduce the Autoregressive Information Cascade Predictor (AutoCas), an LLM-enhanced model designed specifically for cascade popularity prediction. Unlike natural language sequences, cascade data is characterized by complex local topologies, diffusion contexts, and evolving dynamics, requiring specialized adaptations for effective LLM integration. To address these challenges, we first tokenize cascade data to align it with sequence modeling principles. Next, we reformulate cascade diffusion as an autoregressive modeling task to fully harness the architectural strengths of LLMs. Beyond conventional approaches, we further introduce prompt learning to enhance the synergy between LLMs and cascade prediction. Extensive experiments demonstrate that AutoCas significantly outperforms baseline models in cascade popularity prediction while exhibiting scaling behavior inherited from LLMs. Code is available at this repository: https://anonymous.4open.science/r/AutoCas-85C6
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。