arXiv:2503.01880cs.CLcs.AI2025-03被引 4

用生成式AI自动提取社交平台隐含主题,提升分析深度与效率

BEYONDWORDS is All You Need: Agentic Generative AI based Social Media Themes Extractor

  • 结合预训练嵌入与矩阵分解压缩文本,用生成式AI提炼主题
  • 在自闭症群体数据上验证,有效识别复杂语境下的隐性议题
  • 适合研究网络社群话语、需高精度主题分析的学者与机构

社交媒体主题分析有助于理解公众讨论,但传统方法难以应对大规模非结构化文本的复杂性。本文提出一种新方法:利用预训练语言模型的推文嵌入,通过矩阵分解进行降维,并结合生成式AI实现主题提取与优化。该方法先对压缩后的推文表示聚类,再通过代理式思维链(CoT)提示让生成式AI识别并阐述潜在主题,辅以另一大模型进行质量校验。本研究应用于自闭症群体的推文数据,该群体日益通过社交媒体表达经历与挑战。结果表明,该方法能自动化地挖掘关键洞察,同时保留原始话语的丰富性。案例证明其在提升主题分析深度与准确性的潜力,提供可扩展、可适配的通用框架,适用于多样化的在线社区分析场景。

原文摘要 · Abstract (English)

Thematic analysis of social media posts provides a major understanding of public discourse, yet traditional methods often struggle to capture the complexity and nuance of unstructured, large-scale text data. This study introduces a novel methodology for thematic analysis that integrates tweet embeddings from pre-trained language models, dimensionality reduction using and matrix factorization, and generative AI to identify and refine latent themes. Our approach clusters compressed tweet representations and employs generative AI to extract and articulate themes through an agentic Chain of Thought (CoT) prompting, with a secondary LLM for quality assurance. This methodology is applied to tweets from the autistic community, a group that increasingly uses social media to discuss their experiences and challenges. By automating the thematic extraction process, the aim is to uncover key insights while maintaining the richness of the original discourse. This autism case study demonstrates the utility of the proposed approach in improving thematic analysis of social media data, offering a scalable and adaptable framework that can be applied to diverse contexts. The results highlight the potential of combining machine learning and Generative AI to enhance the depth and accuracy of theme identification in online communities.

主题提取生成式AI社交媒体分析自闭症研究

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。