arXiv:2603.11369cs.LGq-bio.PE2026-03

用强化学习模拟抗生素处方,优化耐药性管理策略。

abx_amr_simulator: A simulation environment for antibiotic prescribing policy optimization under antimicrobial resistance

  • 构建可配置的仿真环境,模拟患者群体与抗生素耐药动态。
  • 支持部分可观测性建模,如观测噪声、偏差和延迟。
  • 兼容强化学习框架,适合研究临床决策中的不确定性。

抗菌药物耐药性(AMR)对全球健康构成威胁,削弱抗生素疗效并增加临床决策难度。为此,我们提出 abx_amr_simulator,一个基于 Python 的仿真工具包,可在受控环境中建模抗生素处方与耐药性动态,并兼容强化学习(RL)框架。用户可自定义患者群体、抗生素特异性耐药响应曲线及奖励函数,以平衡即时疗效与长期耐药管理。核心功能包括模块化患者属性配置、基于漏气气球抽象的耐药动态建模,以及通过噪声、偏差和观测延迟实现的部分可观测性模拟。该工具包兼容 Gymnasium RL API,支持在多种临床场景下训练和测试强化学习智能体。从机器学习视角看,它提供了一个可配置的基准环境,用于研究不确定条件下的序列决策问题,尤其是由噪声、偏差和延迟观测引发的部分可观测性。通过可定制、可扩展的框架,abx_amr_simulator 为研究耐药性演化与优化抗生素管理策略提供了有力工具。

原文摘要 · Abstract (English)

Antimicrobial resistance (AMR) poses a global health threat, reducing the effectiveness of antibiotics and complicating clinical decision-making. To address this challenge, we introduce abx_amr_simulator, a Python-based simulation package designed to model antibiotic prescribing and AMR dynamics within a controlled, reinforcement learning (RL)-compatible environment. The simulator allows users to specify patient populations, antibiotic-specific AMR response curves, and reward functions that balance immedi- ate clinical benefit against long-term resistance management. Key features include a modular design for configuring patient attributes, antibiotic resistance dynamics modeled via a leaky-balloon abstraction, and tools to explore partial observability through noise, bias, and delay in observations. The package is compatible with the Gymnasium RL API, enabling users to train and test RL agents under diverse clinical scenarios. From an ML perspective, the package provides a configurable benchmark environment for sequential decision-making under uncertainty, including partial observability induced by noisy, biased, and delayed observations. By providing a customizable and extensible framework, abx_amr_simulator offers a valuable tool for studying AMR dynamics and optimizing antibiotic stewardship strategies under realistic uncertainty.

抗生素管理强化学习耐药性模拟决策优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。