arXiv:2503.09311cs.LGcs.AI2025-03被引 4

用GPT-4生成模拟用户回答,解决政治问卷冷启动难题

Adaptive political surveys and GPT-4: Tackling the cold start problem with simulated user interactions

  • 用GPT-4模拟不同政党的立场生成问卷回答数据
  • 预训练模型使用合成数据后预测误差下降,推荐准确率提升
  • 适合缺乏历史数据的政治调查系统快速部署

自适应问卷根据用户先前回答动态选择问题,但其训练依赖真实用户交互数据,常面临冷启动问题。本文测试大型语言模型(如GPT-4)能否准确生成此类数据,并探索合成数据是否可用于预训练自适应政治问卷的统计模型。基于瑞士投票建议应用Smartvote的真实数据,研究通过比较合成数据与真实数据分布相似性,以及对比随机初始化与合成数据预训练模型的性能,评估该方法有效性。结果表明,GPT-4能精准模拟各政党立场下的用户回答;使用合成数据预训练可显著降低用户响应预测误差,并提升智能推荐系统的候选人推荐准确率。该工作展示了LLM在政治调查等领域的数据生成潜力,有助于缓解数据稀缺问题。

原文摘要 · Abstract (English)

Adaptive questionnaires dynamically select the next question for a survey participant based on their previous answers. Due to digitalisation, they have become a viable alternative to traditional surveys in application areas such as political science. One limitation, however, is their dependency on data to train the model for question selection. Often, such training data (i.e., user interactions) are unavailable a priori. To address this problem, we (i) test whether Large Language Models (LLM) can accurately generate such interaction data and (ii) explore if these synthetic data can be used to pre-train the statistical model of an adaptive political survey. To evaluate this approach, we utilise existing data from the Swiss Voting Advice Application (VAA) Smartvote in two ways: First, we compare the distribution of LLM-generated synthetic data to the real distribution to assess its similarity. Second, we compare the performance of an adaptive questionnaire that is randomly initialised with one pre-trained on synthetic data to assess their suitability for training. We benchmark these results against an "oracle" questionnaire with perfect prior knowledge. We find that an off-the-shelf LLM (GPT-4) accurately generates answers to the Smartvote questionnaire from the perspective of different Swiss parties. Furthermore, we demonstrate that initialising the statistical model with synthetic data can (i) significantly reduce the error in predicting user responses and (ii) increase the candidate recommendation accuracy of the VAA. Our work emphasises the considerable potential of LLMs to create training data to improve the data collection process in adaptive questionnaires in LLM-affine areas such as political surveys.

自适应问卷GPT-4数据生成政治调查

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。