arXiv:2608.28708cs.SEcs.CV2026-08

构建可复用的静默测试平台,评估病理AI在真实工作流中的表现。

STEP: A Modular Silent Trial Engine for Operational Evaluation of Digital Pathology AI in Routine Workflow

论文配图:STEP: A Modular Silent Trial Engine for Operational Evaluation of Digital Pathology AI in Routine Workflow
图 1 · 摘自论文原文
  • 模块化设计分离通用流程与机构特异性集成
  • 支持定时发现病例、滑片推理、失败恢复等完整流程
  • 适合需在真实场景评估AI性能的医疗机构和研究团队

前瞻性静默试验在人工智能模型的回顾验证与临床应用之间起到关键桥梁作用,可在不干预患者管理的前提下,基于真实临床数据评估模型性能与运行可靠性。在计算病理学中,实施静默试验需整合实验室信息系统、数字病理基础设施、计算资源与模型推理管道,传统上依赖定制软件实现。本文开发了病理静默试验引擎(STEP),一个可复用的软件平台,用于在异构临床与计算环境中协调计算病理AI模型的前瞻性静默试验。STEP通过模块化适配器接口,将通用试验编排与机构特定的数据访问及计算基础设施解耦。平台支持定时病例发现、单切片推理提交、确定性幂等性、故障恢复、结果与辅助数据摄入、持久化试验与运行状态记录以及审计日志功能,计算适配器支持本地执行及使用LSF和Slurm的高性能计算环境。STEP已在三家机构部署,用于支持EAGLE模型(基于HE染色全切片图像预测EGFR突变状态)的前瞻性静默评估。通过分离试验级工作流逻辑与站点级集成,STEP实现了跨异构病理环境的统一执行框架,同时保持试验状态的持久性与可审计性。该方法有望减少重复工程投入,推动计算病理AI在干预性临床部署前的系统性真实世界评估。

原文摘要 · Abstract (English)

Prospective silent trials provide an important bridge between retrospective validation of artificial intelligence (AI) models and their use in clinical care by evaluating model performance and operational reliability on live clinical data without influencing patient management. In computational pathology, conducting silent trials requires integration across laboratory information systems, digital pathology infrastructure, computational resources, and model inference pipelines, and these workflows are often implemented using application-specific software. We developed the Silent Trial Engine for Pathology (STEP), a reusable software platform for orchestrating prospective silent trials of computational pathology AI models across heterogeneous clinical and computational environments. STEP separates common trial orchestration from institution-specific data access and compute infrastructure through modular adapter interfaces. The platform supports scheduled case discovery, per-slide inference submission, deterministic idempotency, failure recovery, result and ancillary-data ingestion, persistent trial and run state, and audit logging, with compute adapters supporting local execution and high-performance computing environments using LSF and Slurm. STEP was deployed at three institutions to support prospective silent evaluation of EAGLE, an AI model for predicting EGFR mutation status from hematoxylin and eosin-stained whole-slide images. By separating trial-level workflow logic from site-specific integrations, STEP enables a common execution framework to operate across heterogeneous pathology environments while maintaining durable and auditable trial state. This approach may reduce duplicated engineering effort and facilitate systematic real-world evaluation of computational pathology AI before interventional clinical deployment.

病理AI静默测试工作流

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。