arXiv:2411.15128cs.LGcs.AI2024-11被引 5

HAI-DEF提供医疗领域预训练模型,降低开发成本与门槛。

Health AI Developer Foundations

  • 构建多模态医疗基础模型,支持影像与音频等数据
  • 减少标注数据需求,训练时间缩短,计算成本更低
  • 适合医疗开发者快速搭建模型,尤其关注公平性与验证

稳健的医疗机器学习(ML)模型有望通过加速临床研究、改善工作流程与结果、生成新见解来变革医疗。但从零开始开发此类模型成本高昂,需大量算力、数据和时间(如专家标注)。为应对这些挑战,我们提出健康AI开发者基础(HAI-DEF),一套包含预训练、领域专用基础模型、工具与开发指南的集成方案,旨在加速医疗应用的ML开发。模型覆盖放射科(X光、CT)、组织病理学、皮肤影像与音频等多种模态与领域。这些模型提供领域特定嵌入,使开发过程所需标注数据更少、训练时间更短、计算成本更低。此外,所有模型采用统一接口与风格,注重可用性,便于开发者高效集成。我们在多种任务上评估模型表现,并讨论其应用与评估,强调在不同使用场景中确保有效性、公平性与公平性的必要性。尽管HAI-DEF及其中基础模型降低了医疗领域进入门槛,但仍需针对具体问题与人群数据进行验证。本技术报告将随新增模态与功能持续更新。

原文摘要 · Abstract (English)

Robust medical Machine Learning (ML) models have the potential to revolutionize healthcare by accelerating clinical research, improving workflows and outcomes, and producing novel insights or capabilities. Developing such ML models from scratch is cost prohibitive and requires substantial compute, data, and time (e.g., expert labeling). To address these challenges, we introduce Health AI Developer Foundations (HAI-DEF), a suite of pre-trained, domain-specific foundation models, tools, and recipes to accelerate building ML for health applications. The models cover various modalities and domains, including radiology (X-rays and computed tomography), histopathology, dermatological imaging, and audio. These models provide domain specific embeddings that facilitate AI development with less labeled data, shorter training times, and reduced computational costs compared to traditional approaches. In addition, we utilize a common interface and style across these models, and prioritize usability to enable developers to integrate HAI-DEF efficiently. We present model evaluations across various tasks and conclude with a discussion of their application and evaluation, covering the importance of ensuring efficacy, fairness, and equity. Finally, while HAI-DEF and specifically the foundation models lower the barrier to entry for ML in healthcare, we emphasize the importance of validation with problem- and population-specific data for each desired usage setting. This technical report will be updated over time as more modalities and features are added.

医疗AI基础模型预训练多模态

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。