模型上线后可自动识别新类别并持续学习,无需人工重训。
Learning After Model Deployment
- 动态检测未见类,支持边运行边学新知识
- 实时增量学习新类别,避免重复训练全部数据
- 适合开放环境中的长期部署系统,如智能客服
在传统监督学习中,模型部署后即固定不变。但在动态开放环境中,可能出现未见过类别的样本。为此,本文提出自主模型部署后学习(ALMD)范式:模型能自动检测未见类,并在人工标注后立即、增量式地学习这些新类别,实现持续自主进化。与传统分布外检测不同,其内分布类别会随学习不断扩展;与经典监督学习相比,无需从头训练历史数据。为应对新类别数据稀疏的挑战,本文提出PLDA方法,实现在线动态分布外检测与增量学习。实验验证了该方法的有效性。
原文摘要 · Abstract (English)
In classic supervised learning, once a model is deployed in an application, it is fixed. No updates will be made to it during the application. This is inappropriate for many dynamic and open environments, where unexpected samples from unseen classes may appear. In such an environment, the model should be able to detect these novel samples from unseen classes and learn them after they are labeled. We call this paradigm Autonomous Learning after Model Deployment (ALMD). The learning here is continuous and involves no human engineers. Labeling in this scenario is performed by human co-workers or other knowledgeable agents, which is similar to what humans do when they encounter an unfamiliar object and ask another person for its name. In ALMD, the detection of novel samples is dynamic and differs from traditional out-of-distribution (OOD) detection in that the set of in-distribution (ID) classes expands as new classes are learned during application, whereas ID classes is fixed in traditional OOD detection. Learning is also different from classic supervised learning because in ALMD, we learn the encountered new classes immediately and incrementally. It is difficult to retrain the model from scratch using all the past data from the ID classes and the novel samples from newly discovered classes, as this would be resource- and time-consuming. Apart from these two challenges, ALMD faces the data scarcity issue because instances of new classes often appear sporadically in real-life applications. To address these issues, we propose a novel method, PLDA, which performs dynamic OOD detection and incremental learning of new classes on the fly. Empirical evaluations will demonstrate the effectiveness of PLDA.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。