arXiv:2608.21172cs.LGcs.DC2026-08

让边缘大模型在高温下仍能安全微调,通过温度调控训练和抗攻击聚合。

Thermo-FL: Thermal-Aware Robust Federated Fine-Tuning of Large Language Models for Edge AI

论文配图:Thermo-FL: Thermal-Aware Robust Federated Fine-Tuning of Large Language Models for Edge AI
图 1 · 摘自论文原文
  • 根据设备温度动态调节微调层和上传数据量,减轻热负载
  • 在模拟与实测中均保持高准确率,抗恶意更新攻击能力强
  • 适合部署在资源受限、易过热的边缘AI设备上

联邦微调使大语言模型可在边缘设备上本地适应而无需集中数据,但实际部署需同时应对硬件不稳与更新污染问题。受热约束的客户端可能降频、减慢训练或延迟同步聚合,而拜占庭客户端及通信层攻击者可破坏全局模型更新。为此,我们提出Thermo-FL,一种基于温度感知的联邦LoRA微调框架,将设备温度作为主动控制信号,用于本地适配器训练与稀疏更新传输。客户端根据温升/温降动态调整活跃LoRA层比例与更新密度,降低热应力下的工作负荷。服务器端引入TERRA,一个针对动态稀疏LoRA更新的鲁棒聚合管道,结合范数过滤、掩码感知方向验证、自适应坐标裁剪与掩码感知聚合。我们在大规模模拟器与Jetson物理测试平台评估了Thermo-FL。模拟实验中,其在对抗性稀疏聚合下提升鲁棒性,布尔问答(BoolQ)准确率在干净与攻击场景中均最优,且在GSM8K任务上保持竞争力。物理原型测试显示,它有效稳定设备温度,通过位图稀疏编码压缩上传体积,并在符号翻转、缩放及中间人攻击下维持GSM8K性能。结果表明,安全的边缘大模型适配必须兼顾硬件行为、负载调控、稀疏通信与聚合鲁棒性。

原文摘要 · Abstract (English)

Federated fine-tuning enables large language models to adapt on edge devices without centralizing private data, but practical deployments must address hardware instability and adversarial update corruption together. Thermally constrained clients may throttle, slow local training, or delay synchronous aggregation, while Byzantine clients and communication-layer adversaries can corrupt the updates used to form the global model. To address these challenges, we present Thermo-FL, a thermal-aware federated LoRA fine-tuning framework that uses device temperature as an active control signal for local adapter training and sparse update transmission. On the client side, Thermo-FL adjusts the active LoRA-layer fraction and transmitted update density as devices heat or cool, reducing workload under thermal stress. On the server side, Thermo-FL introduces TERRA, a robust aggregation pipeline for dynamically sparse LoRA updates that combines norm filtering, mask-aware directional validation, adaptive active-coordinate clipping, and mask-aware aggregation. We evaluate Thermo-FL using both a large-scale emulator and a Jetson-based physical testbed. In the emulator, Thermo-FL improves robustness under adversarial sparse aggregation and achieves the strongest BoolQ accuracy across clean and attack settings while remaining competitive on GSM8K. In the physical prototype, Thermo-FL stabilizes device temperature, reduces compressed upload size through bitmap sparse encoding, and preserves GSM8K utility under sign-flip/scale and MITM perturbations. These results show that secure edge LLM adaptation should jointly consider hardware behavior, workload regulation, sparse communication, and aggregation robustness.

边缘AI联邦学习大模型微调温度感知

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。