用不确定性量化分布偏移,提升心电图模型在未知数据上的适应能力。
ADAPTOOD: Uncertainty-Aware Fine-Tuning for Out-of-Distribution ECG Time Series Models

- 基于数据不确定性评估分布偏移严重程度,指导微调策略。
- 在分布外任务中准确率最高提升7%,精确率提升12.9%。
- 适合小样本、多场景下的心电图时间序列模型部署应用。
训练数据与实际微调及部署时的数据常存在差异。尽管机器学习模型有潜力,但在仅有少量标注数据时性能受限,且在传感器、人群和应用场景多样性导致的分布偏移下表现下降。预训练虽有帮助,但真实场景中仍常遇到分布外(OOD)数据,影响模型鲁棒性。现有适配方法通常假设固定分布偏移,难以应对多种类型或严重程度的偏移,尤其忽略偏移严重性——如将大样本熟悉数据与小样本新任务的适配同等对待,限制了泛化能力。为此,我们提出ADAPTOOD框架,利用数据不确定性量化分布偏移严重程度,并指导时间序列模型的微调。该不确定性衡量目标部署分布样本偏离预训练分布的程度,直接反映OOD严重性。框架结合不确定性与低秩模型更新、自适应超参数优化,显著提升适配效果。实验表明,ADAPTOOD在分布外任务中准确率最高提升7%,精确率提升12.9%,且随分布偏移严重性增加仍保持强性能。
原文摘要 · Abstract (English)
Data samples used for training often differ from those encountered during fine-tuning and deployment, and while ML models show promise, their performance remains limited when only small annotated datasets are available. Performance often degrades under distribution shifts caused by diverse sensors, populations, and application settings. Although pre-training helps, models frequently encounter out-of-distribution (OOD) data in real-world settings, leading to reduced robustness. Existing adaptation methods usually assume fixed distribution shifts and struggle when multiple types or severities occur. In particular, they overlook shift severity, for example treating adaptation to a large familiar dataset the same as adaptation to a small dataset with a new task, which limits generalisation. To address this, we propose ADAPTOOD, a novel framework that leverages data uncertainty to quantify distribution shift severity and guide fine-tuning for time series. This uncertainty measures how strongly samples from the target deployment distribution deviate from the pre-training distribution, providing a direct signal of OOD severity. Our framework combines this uncertainty with low-rank model updates and adaptive hyperparameter optimisation to improve adaptation. We show that ADAPTOOD achieves up to 7% higher accuracy and 12.9% higher precision than existing methods in OOD tasks, maintaining strong performance as distribution shift severity increases.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。