arXiv:2409.19300cs.SDcs.AI2024-09被引 3

针对新冠咳嗽音频数据动态变化,提出自适应框架持续保持检测模型性能。

Sustaining model performance for covid-19 detection from dynamic audio data: Development and evaluation of a comprehensive drift-adaptive framework

  • 用MMD监测数据分布变化,触发模型重训练
  • 主动学习使准确率最高提升60%
  • 适合长期运行的医疗诊断系统开发者

背景:新冠疫情凸显了从多样化且动态的数据源中检测疾病的需求。机器学习模型,尤其是卷积神经网络(CNN),展现出潜力。然而,现实数据的动态性可能导致模型漂移,即随着底层数据分布的变化,模型性能随时间下降。解决此问题对维持诊断应用的准确性和可靠性至关重要。目标:本研究旨在开发一个框架,监控模型漂移并采用适应机制以缓解基于动态音频数据的新冠检测模型的性能波动。方法:使用两个众包新冠音频数据集——COVID-19 Sounds和COSWARA。每个数据集分为开发期和后开发期。在开发期的咳嗽录音上训练基准CNN模型,并评估其性能。利用最大均值差异(MMD)检测两时期间数据分布和模型性能的变化。一旦检测到漂移,就触发重训练以更新基准模型。比较了两种适应方法:无监督域适应(UDA)和主动学习(AL)。结果:在COVID-19 Sounds和COSWARA数据集上,UDA分别将平衡准确率提高22%和24%;主动学习带来的提升更高,分别达30%和60%。结论:所提出的框架有效应对了新冠检测中的模型漂移问题,支持模型持续适应不断变化的数据。该方法确保了模型性能的持续稳定,有助于构建稳健的新冠诊断工具,并可推广至其他传染病。

原文摘要 · Abstract (English)

Background: The COVID-19 pandemic has highlighted the need for robust diagnostic tools capable of detecting the disease from diverse and evolving data sources. Machine learning models, especially convolutional neural networks (CNNs), have shown promise. However, the dynamic nature of real-world data can lead to model drift, where performance degrades over time as the underlying data distribution changes. Addressing this challenge is crucial to maintaining accuracy and reliability in diagnostic applications. Objective: This study aims to develop a framework that monitors model drift and employs adaptation mechanisms to mitigate performance fluctuations in COVID-19 detection models trained on dynamic audio data. Methods: Two crowd-sourced COVID-19 audio datasets, COVID-19 Sounds and COSWARA, were used. Each was divided into development and post-development periods. A baseline CNN model was trained and evaluated using cough recordings from the development period. Maximum mean discrepancy (MMD) was used to detect changes in data distributions and model performance between periods. Upon detecting drift, retraining was triggered to update the baseline model. Two adaptation approaches were compared: unsupervised domain adaptation (UDA) and active learning (AL). Results: UDA improved balanced accuracy by up to 22% and 24% for the COVID-19 Sounds and COSWARA datasets, respectively. AL yielded even greater improvements, with increases of up to 30% and 60%, respectively. Conclusions: The proposed framework addresses model drift in COVID-19 detection, enabling continuous adaptation to evolving data. This approach ensures sustained model performance, contributing to robust diagnostic tools for COVID-19 and potentially other infectious diseases.

新冠检测模型漂移主动学习音频分析

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。