arXiv:2409.04122cs.CL2024-09中稿 · ACL

用强化学习筛选用户帖子中的相关文本,提升人格分析效率与准确率。

Prompt-based Personality Profiling: Reinforcement Learning for Relevance Filtering

  • 通过强化学习构建相关性过滤器,自动识别关键内容
  • 在真实数据上仅用部分文本达到全量效果,且上下文缩短60%以上
  • 适合需要高效处理长文本、资源受限的个性化分析场景

作者画像旨在通过分析个体发布的内容推断其特征。尽管提示技术在自然语言理解任务中广泛应用,但监督学习仍是主流方法。主要原因在于分类实例包含大量帖子,可能超出Transformer模型的输入长度限制。即使使用大上下文窗口,全量数据调用API也成本高、速度慢,且面临“大海捞针”难题。为此,我们提出一种新方法:先筛选出相关内容,再仅用相关文本进行用户画像。为避免依赖标注的相关性数据,我们采用基于大语言模型零样本能力的奖励函数,通过强化学习优化过滤器。在两个Twitter语料库上评估大五人格预测表现。在标签分布偏斜的真实数据上,本方法仅用更短上下文即达到全量文本的效果;在人工构造平衡数据上,相关文本筛选使预测准确率显著提升。

原文摘要 · Abstract (English)

Author profiling is the task of inferring characteristics about individuals by analyzing content they share. Supervised machine learning still dominates automatic systems that perform this task, despite the popularity of prompting large language models to address natural language understanding tasks. One reason is that the classification instances consist of large amounts of posts, potentially a whole user profile, which may exceed the input length of Transformers. Even if a model can use a large context window, the entirety of posts makes the application of API-accessed black box systems costly and slow, next to issues which come with such "needle-in-the-haystack" tasks. To mitigate this limitation, we propose a new method for author profiling which aims at distinguishing relevant from irrelevant content first, followed by the actual user profiling only with relevant data. To circumvent the need for relevance-annotated data, we optimize this relevance filter via reinforcement learning with a reward function that utilizes the zero-shot capabilities of large language models. We evaluate our method for Big Five personality trait prediction on two Twitter corpora. On publicly available real-world data with a skewed label distribution, our method shows similar efficacy to using all posts in a user profile, but with a substantially shorter context. An evaluation on a version of these data balanced with artificial posts shows that the filtering to relevant posts leads to a significantly improved accuracy of the predictions.

人格分析强化学习提示工程

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。