arXiv:2410.20017cs.LGcs.AI2024-10NeurIPS被引 1

针对个性化医疗教育,提出新策略精准选政策

Off-Policy Selection for Initiating Human-Centric Experimental Design

  • 按相似特征分组,为每组定制评估标准
  • 无历史数据也能选最优干预策略,提升学习与治疗效果
  • 适用于医疗教育中个体差异大的场景

在医疗与教育等以人为本的任务中,患者与学生间的异质性要求个性化干预。尽管强化学习已被应用,但离线策略选择(OPS)在缺乏新参与者历史数据时难以有效评估和选取策略。本文提出首映离线策略选择(FPS),通过子群体划分与各组定制化评估准则,系统解决个体异质性问题。该方法根据相似特征将个体分组,实现与个体特性匹配的个性化策略选择。在智能辅导系统与脓毒症治疗干预两个具挑战性的应用中验证,FPS显著提升了学生学习成效与住院护理结果。

原文摘要 · Abstract (English)

In human-centric tasks such as healthcare and education, the heterogeneity among patients and students necessitates personalized treatments and instructional interventions. While reinforcement learning (RL) has been utilized in those tasks, off-policy selection (OPS) is pivotal to close the loop by offline evaluating and selecting policies without online interactions, yet current OPS methods often overlook the heterogeneity among participants. Our work is centered on resolving a pivotal challenge in human-centric systems (HCSs): how to select a policy to deploy when a new participant joining the cohort, without having access to any prior offline data collected over the participant? We introduce First-Glance Off-Policy Selection (FPS), a novel approach that systematically addresses participant heterogeneity through sub-group segmentation and tailored OPS criteria to each sub-group. By grouping individuals with similar traits, FPS facilitates personalized policy selection aligned with unique characteristics of each participant or group of participants. FPS is evaluated via two important but challenging applications, intelligent tutoring systems and a healthcare application for sepsis treatment and intervention. FPS presents significant advancement in enhancing learning outcomes of students and in-hospital care outcomes.

强化学习个性化医疗AI离线评估

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。