arXiv:2607.29353cs.LGcs.AI2026-07

一种让边缘设备统一支持多种自适应学习的框架。

Versatile On-device Adaptation at the Edge by Unifying Few-shot, Zero-shot, Continual, and In-context Learning

论文配图:Versatile On-device Adaptation at the Edge by Unifying Few-shot, Zero-shot, Continual, and In-context Learning
图 1 · 摘自论文原文
  • 以嵌入器为中心设计,统一处理少样本、持续、零样本和上下文学习。
  • 在资源受限设备上实现96.8%少样本字符识别准确率,首次硬件验证持续学习效果。
  • 适合需要本地化个性化、隐私敏感或实时响应的智能终端应用。

随着智能边缘设备普及,用户定制(如自定义关键词检测)或患者自适应健康监测的需求日益增长。然而,多数边缘设备依赖固定推理算法,无法本地学习以个性化预测。即使支持学习,也通常仅限于特定场景,如少样本学习(FSL),超出此范围需依赖专用设备或云端重训练,带来高能耗、延迟、缺乏实时性及隐私风险。本文提出嵌入器为中心学习(ECL)框架,统一四种在线学习场景:FSL用于即时定制,持续学习(CL)用于知识积累,零样本学习(ZSL)用于利用语义数据,以及上下文学习(ICL)用于超越分类的适应。我们在硅片上验证了ECL可在资源受限设备上部署于四个真实场景。方法在少样本字符识别上达到新基准:Omniglot数据集5类1样本96.8%,32类1样本83.3%;首次建立关键词检测中持续学习的硬件基线:NeuroBench关键字FSCIL任务200类5样本71.8%。此外,首次实现基于语义数据的零样本学习硬件演示(60.6% 5类语音句子分类)与上下文学习(RegBench第500词时46.2%),功耗低至微瓦到毫瓦级。通过统一多种学习范式,为无需依赖云端的智能边缘设备自适应铺平道路。

原文摘要 · Abstract (English)

With the ever-increasing pervasiveness of smart edge devices, the demand is growing for applications that can be tailored to users (e.g., custom keyword spotting) or patients (e.g., adaptive health monitoring). Yet, most edge devices rely on fixed inference algorithms and thus cannot learn on-device to personalize predictions. When they can, devices typically support only a specific learning scenario, such as few-shot learning (FSL): going beyond this requires resorting either to another specialized device or to cloud-based retraining, which implies significant energy and latency overheads, a lack of real-time capabilities, and privacy concerns. In this work, we introduce embedder-centric learning (ECL), a framework that unifies four different online learning scenarios: FSL for on-the-fly customization, continual learning (CL) for knowledge accumulation, zero-shot learning (ZSL) for leveraging semantic data, and in-context learning (ICL) for adapting beyond classification. We demonstrate in silicon that ECL can be deployed on resource-constrained devices across four real-world use cases representative of the aforementioned learning scenarios. Our approach establishes a new state-of-the-art performance for FSL character recognition (Omniglot: 96.8% for 5-way 1-shot, 83.3% for 32-way 1-shot), and the first hardware baseline for CL in keyword spotting (NeuroBench keyword FSCIL: 71.8% for 200-way 5-shot). Moreover, we present the first hardware demonstrations of ZSL with semantic data (60.6% for 5-way spoken sentence classification) and ICL (46.2% at the 500th token of RegBench) operating at micro-to-milliwatt power budgets. Therefore, by unifying multiple learning scenarios, we pave the way for smart and versatile devices that can adapt right at the edge, without reliance on the cloud.

边缘计算自适应学习少样本学习嵌入器

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。