用合成数据训练路由模型,解决持续学习中专家选择难题。
Expert Routing with Synthetic Data for Continual Learning
- 用合成数据训练一个域判别器,决定测试时调用哪个专家模型。
- 在视觉和语言任务上均优于现有持续学习方法,尤其在跨域适应时表现更优。
- 适合需要跨机构共享模型但不共享数据的场景,如医疗、金融领域。
在许多现实场景中,由于法规和经济激励,机构间可共享模型但无法共享数据。在此背景下,从业者希望将模型适应新领域,同时不损失对旧领域的性能(即避免灾难性遗忘)。单一模型难以达成此目标,而采用针对不同领域的专家模型集合则具有潜力。然而核心挑战在于推理时如何选择合适的专家。本文提出生成-判别(G2D)方法,利用合成数据训练一个域判别器,在推理时将样本路由至对应专家。令人意外的是,将合成数据用于训练路由判别器,比直接用其训练下游分类器(传统做法)更有效。实验表明,G2D在视觉与语言模态的任务中均优于现有域增量持续学习方法,为合成数据在终身学习中的应用提供了新视角。
原文摘要 · Abstract (English)
In many real-world settings, regulations and economic incentives permit the sharing of models but not data across institutional boundaries. In such scenarios, practitioners might hope to adapt models to new domains, without losing performance on previous domains (so-called catastrophic forgetting). While any single model may struggle to achieve this goal, learning an ensemble of domain-specific experts offers the potential to adapt more closely to each individual institution. However, a core challenge in this context is determining which expert to deploy at test time. In this paper, we propose Generate to Discriminate (G2D), a domain-incremental continual learning method that leverages synthetic data to train a domain-discriminator that routes samples at inference time to the appropriate expert. Surprisingly, we find that leveraging synthetic data in this capacity is more effective than using the samples to \textit{directly} train the downstream classifier (the more common approach to leveraging synthetic data in the lifelong learning literature). We observe that G2D outperforms competitive domain-incremental learning methods on tasks in both vision and language modalities, providing a new perspective on the use of synthetic data in the lifelong learning literature.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。