统一处理医学影像数据,让多源影像模型训练更简单
RadHarmony: Radiological Data Handling in the Era of Agentic AI

- 提供统一接口整合不同格式的医学影像数据
- 支持胸片、CT、MRI,可处理标签、掩码、报告等多模态数据
- 内置AI助手自动完成数据集成流程,降低使用门槛
在放射科图像上训练深度学习模型需整合来自不同来源、文件格式、目录结构、标签模式和标注类型的数据。我们提出 RadHarmony,一个开源 Python 库,提供加载、标准化和增强放射科数据集的统一 API,主要针对胸部 X 光,初步支持 CT 和 MRI。RadHarmony 将 24 个公开数据集的元数据统一为单一表格格式,封装 MONAI 的映射式数据集以实现深度学习就绪的样本输出,并支持分类标签、分割掩码、边界框和放射科报告文本,通过交互式可视化工具实现数据探索与验证。为降低新数据集集成门槛,RadHarmony 引入 AI 代理技能,指导从原始数据检查到代码生成与测试的完整集成流程。我们通过预训练 RadHarmony-ViT 模型展示该库实用性,该模型融合三个异构胸部 X 光数据集,无需特定数据集代码。代码与预训练权重可在 https://github.com/f10409/RadHarmony 获取。
原文摘要 · Abstract (English)
Training deep learning models on radiological images requires integrating heterogeneous datasets across different sources, file formats, directory layouts, label schemas, and annotation types. We present RadHarmony, an open-source Python library that provides a unified API for loading, harmonizing, and augmenting radiological datasets, with a primary focus on chest radiographs and early support for computed tomography (CT) and magnetic resonance imaging (MRI). RadHarmony standardizes metadata from 24 public datasets into a single tabular format, wraps MONAI's map-style datasets for deep-learning-ready sample delivery with optional on-disk caching, and supports classification labels, segmentation masks, bounding boxes, and radiology report text through a single interface, with an interactive visualization tool for dataset exploration and verification. To lower the barrier for integrating new datasets, RadHarmony introduces an AI-agent skill that guides the full integration workflow from raw data inspection through code generation and testing. We demonstrate the library's utility by pretraining RadHarmony-ViT, a reference vision transformer baseline that combines three heterogeneous chest radiograph datasets with no dataset-specific code. The code and pretrained model weights are available at https://github.com/f10409/RadHarmony.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。