用大模型预测食品政策效果,准确率达80%
Leveraging LLMs for Predictive Insights in Food Policy and Behavioral Interventions
- 微调大模型分析政策干预的饮食影响方向
- 80%准确率,75个提示达最佳效果
- 适合政策制定者与行为科学研究者参考
食物消费与生产对全球温室气体排放贡献显著,是应对气候变化的关键领域。过去二十年中,食品政策尝试通过减少食物浪费和限制反刍类肉类消费来改变生产和消费模式。尽管实证证据不断积累,但评估特定情境下政策的有效性仍面临外部有效性挑战。本文表明,经过微调的大语言模型可在约80%的实证研究中准确预测基于饮食干预和政策的成果方向(如食物选择、销量、浪费)。达到最优性能需约75个提示,超过该数量后出现灾难性遗忘。输入细节越丰富,预测越准,但模型在未见研究上仍存局限,凸显代表性训练样本的重要性。随着大模型持续演进,其在推动数据驱动、证据为基础的政策制定方面具有潜力。
原文摘要 · Abstract (English)
Food consumption and production contribute significantly to global greenhouse gas emissions, making them crucial entry points for mitigating climate change and maintaining a liveable planet. Over the past two decades, food policy initiatives have explored interventions to reshape production and consumption patterns, focusing on reducing food waste and curbing ruminant meat consumption. While the evidence of "what works" improves, evaluating which policies are appropriate and effective in specific contexts remains difficult due to external validity challenges. This paper demonstrates that a fine-tuned large language model (LLM) can accurately predict the direction of outcomes in approximately 80\% of empirical studies measuring dietary-based impacts (e.g. food choices, sales, waste) resulting from behavioral interventions and policies. Approximately 75 prompts were required to achieve optimal results, with performance showing signs of catastrophic loss beyond this point. Our findings indicate that greater input detail enhances predictive accuracy, although the model still faces challenges with unseen studies, underscoring the importance of a representative training sample. As LLMs continue to improve and diversify, they hold promise for advancing data-driven, evidence-based policymaking.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。