arXiv:2410.03794cs.LG2024-10被引 10

用预训练时序模型实现跨数据集的医疗时序分类,无需重调结构。

Repurposing Foundation Model for Generalizable Medical Time Series Classification

  • 用动态通道嵌入和标签查询,适配任意通道数和类别数
  • 在5个数据集上比专用模型最高提升35%的F1分数
  • 仅需0.1%参数量微调,适合临床快速部署

医疗时序分类因数据集间异质性(如通道数、信号长度、任务定义、患者特征差异)导致泛化能力差。为此,我们提出FORMED框架,将通用时序预训练基础模型复用于医疗时序分类,实现对未见数据集的高度泛化。FORMED结合主干模型与新型分类器:(1) 任务特定通道嵌入与标签查询,动态匹配任意通道数与类别数;(2) 共享解码注意力层,跨数据集联合训练,通过任务无关特征-查询交互捕获医学领域知识。复用后,仅需轻量级标签查询训练(0.1%参数),即可无缝适应新数据集,无需全量微调或架构重构。在5个多样化医疗时序数据集上评估,对比11种专用模型(TSM)和4种专用适配方法(TSA),结果表明FORMED表现显著领先,在ADFTD数据集上F1-score绝对提升最高达35%。进一步分析显示其在不同通道配置、序列长度和临床任务下均具稳定泛化能力,是真实场景部署的关键挑战。通过解耦领域不变表示学习与任务特异性适配,FORMED建立了一种可扩展、低资源的医疗健康领域基础模型复用范式,强调临床适应性,为实际应用提供可行路径。

原文摘要 · Abstract (English)

Medical time series (MedTS) classification suffers from poor generalizability in real-world deployment due to inter- and intra-dataset heterogeneity, such as varying numbers of channels, signal lengths, task definitions, and patient characteristics. To address this, we propose FORMED, a novel framework for repurposing a backbone foundation model, pre-trained on generic time series, to enable highly generalizable MedTS classification on unseen datasets. FORMED combines the backbone with a novel classifier comprising two components: (1) task-specific channel embeddings and label queries, dynamically sized to match any number of channels and target classes, and (2) a shared decoding attention layer, jointly trained across datasets to capture medical domain knowledge through task-agnostic feature-query interactions. After repurposing, FORMED achieves seamless adaptation to unseen MedTS datasets through lightweight label query training (0.1% of parameters), eliminating the need for full fine-tuning or architectural redesign. We evaluate FORMED on 5 diverse MedTS datasets, benchmarking against 11 Task-Specific Models (TSM) and 4 Task-Specific Adaptation (TSA) methods. Our results demonstrate FORMED's dominant performance, achieving up to 35% absolute improvement in F1-score (on ADFTD dataset) over specialized baselines. Further analysis reveals consistent generalization across varying channel configurations, time series lengths, and clinical tasks, which are key challenges in real-world deployment. By decoupling domain-invariant representation learning from task-specific adaptation, FORMED establishes a scalable and resource-efficient paradigm for foundation model repurposing in healthcare. This approach prioritizes clinical adaptability over rigid task-centric design, offering a practical pathway for real-world implementation.

医疗时序基础模型泛化能力轻量化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。