FastOMOP用分层架构实现医疗数据自动化生成真实世界证据,确保安全可审计。
FastOMOP: A Foundational Architecture for Reliable Agentic Real-World Evidence Generation on OMOP CDM data

- 分离治理、可观测性与编排三层,通过边界验证保障安全
- 在三个数据集上可靠性达0.84-0.94,对抗攻击和越界请求零通过
- 适合需要可信赖自动化研究的临床研究者与数据科学家
观测医学结果合作计划通用数据模型(OMOP CDM)由观测健康数据科学与信息学(OHDSI)协作维护,已整合全球83个国家近十亿患者的电子病历数据。然而,从这些库中生成真实世界证据(RWE)仍依赖人工,需兼具临床、流行病学与技术专长。大语言模型与多智能体系统虽在临床任务中展现潜力,但自动化RWE面临根本挑战:智能体系统存在涌现行为、协作失败与安全风险,现有方法无法有效管控。目前尚无基础设施能保证整个生命周期中智能体RWE生成的灵活性、安全性与可审计性。本文提出FastOMOP——一个开源多智能体架构,通过将治理、可观测性与编排三层次与可插拔智能体团队解耦,实现安全控制。治理在流程边界以确定性验证强制执行,独立于智能体推理,确保无任何违规或幻觉智能体可绕过安全机制。用于表型定义、研究设计与统计分析的智能体团队通过受控工具暴露继承该安全保障。我们在三个OMOP CDM数据集上验证:来自Synthea的合成数据、MIMIC-IV以及兰开夏教学医院的真实世界NHS数据(IDRIL)。FastOMOP在自然语言转SQL智能体团队上获得0.84-0.94的可靠性评分,对抗攻击与越界请求阻断率为100%,证明流程边界治理可独立于模型选择提供安全保证。结果表明,当前RWE部署中的可靠性差距源于架构而非模型能力,确立FastOMOP为渐进式RWE自动化的有监管架构。
原文摘要 · Abstract (English)
The Observational Medical Outcomes Partnership Common Data Model (OMOP CDM), maintained by the Observational Health Data Sciences and Informatics (OHDSI) collaboration, enabled the harmonisation of electronic health records data of nearly one billion patients in 83 countries. Yet generating real-world evidence (RWE) from these repositories remains a manual process requiring clinical, epidemiological and technical expertise. LLMs and multi-agent systems have shown promise for clinical tasks, but RWE automation exposes a fundamental challenge: agentic systems introduce emergent behaviours, coordination failures and safety risks that existing approaches fail to govern. No infrastructure exists to ensure agentic RWE generation is flexible, safe and auditable across the lifecycle. We introduce FastOMOP, an open-source multi-agent architecture that addresses this gap by separating three infrastructure layers, governance, observability and orchestration, from pluggable agent-teams. Governance is enforced at the process boundary through deterministic validation independent of agent reasoning, ensuring no compromised or hallucinating agent can bypass safety controls. Agent teams for phenotyping, study design and statistical analysis inherit these guarantees through controlled tool exposure. We validated FastOMOP using a natural-language-to-SQL agent team across three OMOP CDM datasets: synthetic data from Synthea, MIMIC-IV and a real-world NHS dataset from Lancashire Teaching Hospitals (IDRIL). FastOMOP achieved reliability scores of 0.84-0.94 with perfect adversarial and out-of-scope block rates, demonstrating process-boundary governance delivers safety guarantees independent of model choice. These results indicate that the reliability gap in RWE deployment is architectural rather than model capability, and establish FastOMOP as a governed architecture for progressive RWE automation.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。