arXiv:2512.21395cs.LG2025-12被引 2

用强化学习生成医学数据,小样本下效果优于传统方法。

A Reinforcement Learning Approach to Synthetic Data Generation

  • 将数据生成建模为强化学习问题,用奖励驱动优化生成器。
  • 在小数据集上达到与扩散模型相当的预测性能,且隐私风险更低。
  • 适合数据稀缺的医学研究场景,尤其关注隐私保护的研究者。

合成数据生成(SDG)是实现生物医学研究中数据共享并保护患者隐私的有前景方法。然而,现有生成模型通常需要大量数据和复杂的训练过程,在生物医学研究常见的小样本设置中应用受限。本文将SDG重新建模为强化学习(RL)问题,提出RLSyn框架,将数据生成器视为患者记录上的随机策略,并利用基于判别器奖励的近端策略优化进行训练。我们在两个生物医学数据集——AI-READI和MIMIC-IV上评估RLSyn,与最先进的生成对抗网络(GANs)和基于扩散的方法进行对比,涵盖广泛的隐私、效用和保真度评估。在MIMIC-IV数据集上,RLSyn的预测效用与扩散模型相当(S2R AUC 0.902 vs. 0.906),在保真度上略优(NMI 0.001 vs. 0.003;DWD 2.073 vs. 2.797),且隐私风险相近(~0.50的成员推断风险AUC)。在更小的AI-READI数据集上,RLSyn再次匹配扩散模型的效用(S2R AUC 0.873 vs. 0.871),保真度更高(NMI 0.001 vs. 0.002;DWD 13.352 vs. 16.441),对成员推断攻击的脆弱性显著降低(AUC 0.544 vs. 0.601)。两种方法均在两个数据集上显著优于GANs的效用和保真度。结果表明,强化学习为小样本下的合成生物医学数据生成提供了一种原理性强且高效的方法。

原文摘要 · Abstract (English)

Synthetic data generation (SDG) is a promising approach for enabling data sharing in biomedical studies while preserving patient privacy. Yet, state-of-the-art generative models often require large datasets and complex training procedures, limiting their applicability in small-sample settings common in biomedical research. This study aims to develop a more principled and efficient approach to SDG and evaluate its efficacy for biomedical applications. In this work, we reframe SDG as a reinforcement learning (RL) problem and introduce RLSyn, a novel framework that models the data generator as a stochastic policy over patient records and optimizes it using Proximal Policy Optimization with discriminator-derived rewards. We evaluate RLSyn on two biomedical datasets--AI-READI and MIMIC-IV--and benchmark it against state-of-the-art generative adversarial networks (GANs) and diffusion-based methods across extensive privacy, utility, and fidelity evaluations. On MIMIC-IV, RLSyn achieves predictive utility comparable to diffusion models (S2R AUC 0.902 vs 0.906 respectively) while slightly outperforming them in fidelity (NMI 0.001 vs. 0.003; DWD 2.073 vs. 2.797) and achieving comparable, low privacy risk (~0.50 membership inference risk AUC). On the smaller AI-READI dataset, RLSyn again matches diffusion-based utility (S2R AUC 0.873 vs. 0.871), while achieving higher fidelity (NMI 0.001 vs. 0.002; DWD 13.352 vs. 16.441) and significantly lower vulnerability to membership inference attacks (AUC 0.544 vs. 0.601). Both RLSyn and diffusion-based models substantially outperform GANs across utility and fidelity on both datasets. Our results suggest that reinforcement learning provides a principled and effective approach for synthetic biomedical data generation, particularly in data-scarce regimes.

合成数据强化学习医学数据隐私保护

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。