无需数据即可让物联网模型自适应环境变化,性能提升超20%。
Chorus: Harmonizing Context and Sensing Signals for Data-Free Model Customization in IoT
- 用无标签数据学习可迁移的环境特征,桥接环境与传感数据的差异
- 在未见环境下性能比顶尖方法高20.2%,推理延迟接近纯传感器部署
- 适合边缘设备持续适应复杂环境,无需重新训练
实现可扩展物联网感知的关键瓶颈在于高效适应已训练AI模型至新部署环境。环境变化(如传感器位置或环境条件改变)会显著影响感知模式并降低模型性能。我们提出Chorus,一种基于上下文桥接、无需数据的后部署模型定制方法,可在不依赖目标域传感器数据或重训练的前提下,将感知模型适配至未见环境。Chorus通过无标签传感器-环境配对学习紧凑且可迁移的上下文表征,并将其与传感器隐空间对齐,实现环境泛化与传感数据泛化的融合。推理时采用轻量级门控预测头整合上下文先验,结合自适应缓存机制,在无环境变化时复用上下文表征,降低设备端开销。在IMU感知、语音增强和WiFi感知任务中,面对多样环境变化的实验表明,Chorus在未见环境下性能优于现有最优方法最高达20.2%,推理延迟与仅使用传感器部署相当,且在连续环境转换和不同描述方式下保持稳定。视频演示见 https://youtu.be/yANTZsk0TVU。
原文摘要 · Abstract (English)
A key bottleneck toward scalable IoT sensing is efficiently adapting trained AI models to new deployment conditions. Context shifts, such as changes in sensor placement or ambient environments, can substantially alter sensing patterns and degrade model performance. We present Chorus, a context-bridged, data-free post-deployment model customization approach that adapts sensing models to unseen contexts without requiring target-domain sensor data or post-deployment retraining. Chorus learns compact, transferable context representations and aligns them with the sensor latent space using unlabeled sensor-context pairs, bridging context generalization with sensing-data generalization. It then uses a lightweight gated prediction head to integrate context priors at inference and an adaptive caching mechanism to reuse context representations when no context shift is detected, reducing on-device overhead. Experiments on IMU sensing, speech enhancement, and WiFi sensing under diverse context shifts show that Chorus outperforms state-of-the-art baselines by up to 20.2% in unseen contexts, achieves inference latency comparable to sensor-only deployment, and remains stable under continuous context transitions and varied context descriptions. A video demonstration is available at https://youtu.be/yANTZsk0TVU.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。