arXiv:2606.27634cs.LG2026-06

研究小模型持续学习中的遗忘问题,提出用检查点监控稳定性。

Continual Learning for Sequential Personalization of Small Language Models: A Stability Monitoring Analysis

  • 通过保存每次微调后的检查点,分阶段评估任务表现
  • 发现轻量级参考集分析可揭示任务指标忽略的模型不稳定性
  • 适合关注边缘设备个性化模型长期稳定性的研究者

小型语言模型(SLMs)正被部署在笔记本等边缘设备上,实现私密、低延迟的本地个性化应用。但个性化需模型随用户或任务数据动态适应,进入持续学习场景,存在灾难性遗忘风险——学习新知识会损害旧任务性能或整体能力。近期基准测试(如TRACE)显示,持续微调会显著削弱对齐大模型的通用能力。本文针对小模型的序列化LoRA个性化展开研究,每次适配后保存模型检查点,并在当前任务、过往任务及固定参考集上评估性能。该检查点级协议使我们能够监测任务表现、遗忘程度和参考集漂移。结果表明,轻量级参考集分布诊断可揭示小模型在序列化LoRA个性化中特有的不稳定模式,包括仅依赖任务级指标时难以察觉的有害适应。本工作旨在为持续学习环境下小模型稳定性监控开辟新方向。

原文摘要 · Abstract (English)

Small Language Models (SLMs) are increasingly being considered for deployment on edge devices such as laptops, enabling private, low-latency, and locally personalized applications. However, personalization requires models to adapt over time to evolving user- or task-specific data, placing them in a continual learning setting. This creates the risk of catastrophic forgetting, where learning new information degrades performance on previously learned tasks or broader model capabilities. Recent benchmarks such as TRACE have shown that continual fine-tuning can significantly degrade the general abilities of aligned large language models. In this work, we present a study for sequential LoRA personalization of SLMs. We save model checkpoints after each adaptation stage and evaluate them on current tasks, previously seen tasks, and a fixed reference set. This checkpoint-level protocol enables us to monitor task performance, forgetting, and reference set drift over time. We show that lightweight reference set distributional diagnostics can reveal model-specific instability patterns during sequential LoRA personalization of SLMs, including cases where task-level metrics alone hide harmful adaptation. We hope this can highlight new research avenues for monitoring stability of SLMs in a continual learning setting.

持续学习小模型个性化遗忘检测

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。