arXiv:2503.22719cs.AI2025-03被引 3

用大模型模拟孕产妇健康干预,量化不确定性并指导决策。

LLM-based Agent Simulation for Maternal Health Interventions: Uncertainty Estimation and Decision-focused Evaluation

论文配图:LLM-based Agent Simulation for Maternal Health Interventions: Uncertainty Estimation and Decision-focused Evaluation
图 1 · 摘自论文原文
  • 用大模型生成行为数据,替代传统需大量历史数据的模拟方法。
  • 通过多样本熵值估计不确定性,提升模型准确率与校准度。
  • 适合数据稀缺环境下快速评估健康干预方案可行性。

基于代理的模拟对建模复杂人类行为至关重要,但传统方法依赖大量领域知识和数据。在历史与反事实数据有限的医疗场景中,大语言模型(LLMs)可借助广泛世界知识提供替代方案。本研究构建了一个基于LLM的模拟框架,用于预测孕妇在接受自动消息(对照组)或真人代表(干预组)健康信息时的听信行为。由于不确定性量化对健康干预决策至关重要,我们提出一种基于多样本二元熵的LLM认知不确定性估计方法,并采用集成策略增强模型鲁棒性,相比单个模型显著提升F1分数与模型校准效果。此外,我们采用以决策为导向的评估方式,展示如何利用LLM预测支持干预可行性和试验设计。该方法可推广至公共卫生、灾害响应等严重数据受限领域的快速评估。所有代码与提示语详见https://github.com/sarahmart/LLM-ABS-ARMMAN-prediction。

原文摘要 · Abstract (English)

Agent-based simulation is crucial for modeling complex human behavior, yet traditional approaches require extensive domain knowledge and large datasets. In data-scarce healthcare settings where historic and counterfactual data are limited, large language models (LLMs) offer a promising alternative by leveraging broad world knowledge. This study examines an LLM-driven simulation of a maternal mobile health program, predicting beneficiaries' listening behavior when they receive health information via automated messages (control) or live representatives (intervention). Since uncertainty quantification is critical for decision-making in health interventions, we propose an LLM epistemic uncertainty estimation method based on binary entropy across multiple samples. We enhance model robustness through ensemble approaches, improving F1 score and model calibration compared to individual models. Beyond direct evaluation, we take a decision-focused approach, demonstrating how LLM predictions inform intervention feasibility and trial implementation in data-limited settings. The proposed method extends to public health, disaster response, and other domains requiring rapid intervention assessment under severe data constraints. All code and prompts used for this work can be found at https://github.com/sarahmart/LLM-ABS-ARMMAN-prediction.

大模型健康干预不确定性估计模拟仿真

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。