arXiv:2409.07796cs.CVcs.AI2024-09中稿 · ACM SenSys 2026被引 3

让物联网设备在无网环境下自动适应环境变化,提升识别准确率。

WildFit: Autonomous In-situ Model Adaptation for Resource-Constrained IoT Systems

  • 利用背景变化慢于物种特征的规律,在设备端合成训练数据。
  • 更新频率减少50%,准确率提高1.5%,37天仅耗电11.2Wh。
  • 适合野外监测、电池供电的低资源智能设备部署。

资源受限的物联网设备日益依赖深度学习模型,但光照、天气和季节变化导致域偏移,使模型准确率大幅下降。尽管云端重训可缓解此问题,但多数物联网部署面临连接有限与能耗约束,传统微调不可行。本文以野生动物生态监测为场景,摄像头需在无可靠网络条件下跨季节、跨天气保持物种分类准确。提出WildFit框架,核心思想是背景变化频率低于目标物种视觉特征。该框架结合背景感知的数据合成(在设备端生成训练样本)与漂移感知的微调策略(仅在必要时触发更新),以节省资源。实验表明,背景感知合成方法优于高效基线7.3%,超过扩散模型3.0%,且速度更快一个数量级;漂移感知微调实现帕累托最优,更新次数减少50%,准确率提升1.5%;端到端系统相较域自适应方法性能提升20%-35%,37天总功耗仅11.2Wh,支持电池供电部署。

原文摘要 · Abstract (English)

Resource-constrained IoT devices increasingly rely on deep learning models, however, these models experience significant accuracy drops due to domain shifts when encountering variations in lighting, weather, and seasonal conditions. While cloud-based retraining can address this issue, many IoT deployments operate with limited connectivity and energy constraints, making traditional fine-tuning approaches impractical. We explore this challenge through the lens of wildlife ecology, where camera traps must maintain accurate species classification across changing seasons, weather, and habitats without reliable connectivity. We introduce WildFit, an autonomous in-situ adaptation framework that leverages the key insight that background scenes change more frequently than the visual characteristics of monitored species. WildFit combines background-aware synthesis to generate training samples on-device with drift-aware fine-tuning that triggers model updates only when necessary to conserve resources. Our background-aware synthesis surpasses efficient baselines by 7.3% and diffusion models by 3.0% while being orders of magnitude faster, our drift-aware fine-tuning achieves Pareto optimality with 50% fewer updates and 1.5% higher accuracy, and the end-to-end system outperforms domain adaptation approaches by 20-35% while consuming only 11.2 Wh over 37 days-enabling battery-powered deployment.

边缘计算自适应模型物联网节能

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。