自动化医疗数据全流程推理,免人工干预。
Agentic AI framework for End-to-End Medical Data Inference
- 用多个专用智能体自动完成数据接入到推理全过程。
- 在老年医学等三类数据上实现端到端处理,准确识别数据类型与疾病特征。
- 适合临床医生和工程师快速部署AI模型,降低开发成本。
医疗领域机器学习解决方案的构建与部署仍因预处理流程碎片化、模型兼容性问题及严格的数据隐私要求而昂贵且耗时。本文提出一种智能体式AI框架,通过模块化、任务专一的智能体系统,实现从数据接入到推理的全流程自动化。该系统处理结构化与非结构化数据,自动完成特征选择、模型选型与预处理建议,无需人工介入。我们在老年医学、姑息治疗及结肠镜影像等公开数据集上进行评估。例如,在焦虑症结构化数据和结肠镜息肉图像数据中,系统首先由数据接入识别智能体检测文件类型,随后由数据匿名化智能体确保隐私合规;特征提取智能体采用基于嵌入的方法处理表格数据(提取所有列名),并使用多阶段MedGemma方法处理图像数据(推断模态与疾病名称);模型-数据特征匹配智能体从预置库中选出最优模型;预处理推荐与执行智能体根据数据类型与模型需求定制预处理流程;最终由模型推理智能体运行选定模型,并利用SHAP、LIME和DETR注意力图生成可解释输出。该框架显著减少重复专家干预,为临床环境中落地AI提供可扩展、低成本路径。
原文摘要 · Abstract (English)
Building and deploying machine learning solutions in healthcare remains expensive and labor-intensive due to fragmented preprocessing workflows, model compatibility issues, and stringent data privacy constraints. In this work, we introduce an Agentic AI framework that automates the entire clinical data pipeline, from ingestion to inference, through a system of modular, task-specific agents. These agents handle both structured and unstructured data, enabling automatic feature selection, model selection, and preprocessing recommendation without manual intervention. We evaluate the system on publicly available datasets from geriatrics, palliative care, and colonoscopy imaging. For example, in the case of structured data (anxiety data) and unstructured data (colonoscopy polyps data), the pipeline begins with file-type detection by the Ingestion Identifier Agent, followed by the Data Anonymizer Agent ensuring privacy compliance, where we first identify the data type and then anonymize it. The Feature Extraction Agent identifies features using an embedding-based approach for tabular data, extracting all column names, and a multi-stage MedGemma-based approach for image data, which infers modality and disease name. These features guide the Model-Data Feature Matcher Agent in selecting the best-fit model from a curated repository. The Preprocessing Recommender Agent and Preprocessing Implementor Agent then apply tailored preprocessing based on data type and model requirements. Finally, the ``Model Inference Agent" runs the selected model on the uploaded data and generates interpretable outputs using tools like SHAP, LIME, and DETR attention maps. By automating these high-friction stages of the ML lifecycle, the proposed framework reduces the need for repeated expert intervention, offering a scalable, cost-efficient pathway for operationalizing AI in clinical environments.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。