arXiv:2607.02988cs.CV2026-07

零阶优化+模型融合,让低资源设备也能实时自适应推理。

Cross-device Collaborative Test-time Adaptation with Zeroth-order Optimization and Model Merging

论文配图:Cross-device Collaborative Test-time Adaptation with Zeroth-order Optimization and Model Merging
图 1 · 摘自论文原文
  • 用零阶优化替代反向传播,仅需前向计算,降低内存开销。
  • 通过模型合并降低高维优化难度,提升跨设备协同效果。
  • 适合边缘设备部署,尤其在图像退化和风格迁移场景下表现优。

测试时自适应(TTA)通过利用输入的测试数据实时更新模型以缓解域偏移问题。现有大多数TTA方法依赖资源密集型的反向传播(BP)进行模型更新,尤其需要大量内存,难以在资源受限设备(如边缘设备)上部署。为此,本文在跨设备协同TTA(CDC-TTA)框架下,结合零阶优化(ZOO)与模型合并技术,该框架由资源丰富与资源有限设备混合组成,各设备间共享模型信息(如权重)。本方法通过引入ZOO,仅需前向传播即可执行更新,避免了高耗能的反向传播。同时,为缓解ZOO带来的高维优化挑战,采用多个共享模型的合并策略,并将合并系数作为优化目标,有效降低优化维度。此外,提出一种独特的预处理策略,剪除模型内非关键权重并减少模型间冗余信息,增强ZOO与模型合并的协同效果。在常见图像退化与风格迁移基准上实验证明了方法的有效性。

原文摘要 · Abstract (English)

Test-time adaptation (TTA) mitigates domain shifts by using incoming test data to update a model on the fly. The majority of TTA methods require resource-intensive backpropagation (BP) for model updates, particularly demanding large memory sizes, which makes it infeasible to deploy them on resource-limited devices (e.g., edge devices). To address this issue, we integrate two different techniques, zeroth-order optimization (ZOO) and model merging, under the recently established cross-device collaborative TTA (CDC-TTA) framework, where the system is composed of a mixture of resource-abundant and resource-limited devices, and the model information (e.g., model weights obtained on each device) is shared across the devices. Our method is executable on resource-limited devices by introducing ZOO, which requires only forward processing and bypasses the resource-intensive BP optimization. Concurrently, to mitigate the high-dimensional optimization difficulty caused by the side effect of ZOO, we incorporate model merging of the shared multiple models and set the merge coefficients as the optimization objective, which successfully reduces the optimization dimension. In addition, to enhance the synergistic combination of ZOO and model merging, we propose a unique preprocessing strategy that trims intra-model non-influential weights and reduces the inter-model information redundancy. We empirically confirmed the effectiveness of our method using common corruption and style-transferred image benchmarks.

测试时适应零阶优化边缘计算模型合并

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。