arXiv:2602.11655cs.CRcs.AI2026-02被引 1

用轻量LoRA适配器实现边缘设备持续学习,提升恶意软件检测能力。

LoRA-based Parameter-Efficient LLMs for Continuous Learning in Edge-based Malware Detection

  • 在边缘设备上用LoRA微调小模型,仅交换适配器参数
  • 跨设备共享知识后对未知攻击识别准确率提升20%-25%
  • 适配器仅增加不到1%模型大小,适合资源受限设备

边缘设备的普及带来了实时恶意软件检测的迫切需求,但其计算与内存限制使大型语言模型难以部署。现有静态或集中重训练模型在面对不断演化的威胁和异构流量时性能下降,而本地训练模型又形成信息孤岛。本文提出一种基于LoRA的连续学习架构,在边缘端使用轻量Transformer模型(DistilBERT、DistilGPT-2、TinyT5)进行本地增量微调,仅聚合并分发LoRA适配器,实现跨设备知识共享而不传输原始数据。在Edge-IIoTset与TON-IoT两个公开物联网安全数据集上,经多轮学习模拟威胁演化,相比孤立微调,该方法在遭遇其他域的未知攻击时准确率提升20%-25%,且损失与F1值保持稳定。LoRA模块仅增加约0.6-1.8 MB(<1%模型大小),适用于受限边缘硬件。

原文摘要 · Abstract (English)

The proliferation of edge devices has created an urgent need for security solutions capable of detecting malware in real time while operating under strict computational and memory constraints. Recently, Large Language Models (LLMs) have demonstrated remarkable capabilities in recognizing complex patterns, yet their deployment on edge devices remains impractical due to their resource demands. However, in edge malware detection, static or centrally retrained models degrade under evolving threats and heterogeneous traffic; locally trained models become siloed and fail to transfer across domains. To overcome these limitations, in this paper, we present a continuous learning architecture for edge-based malware detection that combines local adaptation on each device with global knowledge sharing through parameter-efficient LoRA adapters. Lightweight transformer models (DistilBERT, DistilGPT-2, TinyT5) run on edge nodes and are incrementally fine-tuned on device-specific traffic; only the resulting LoRA modules are aggregated by a lightweight coordinator and redistributed, enabling cross-device generalization without exchanging raw data. We evaluate on two public IoT security datasets, Edge-IIoTset and TON-IoT, under multi-round learning to simulate evolving threats. Compared to isolated fine-tuning, the LoRA-based exchange yields up to 20-25% accuracy gains when models encounter previously unseen attacks from another domain, while maintaining stable loss and F1 across rounds. LoRA adds less than 1% to model size (~0.6-1.8 MB), making updates practical for constrained edge hardware.

边缘计算恶意软件检测LoRA持续学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。