跨模型边缘推理通信新框架,提升实时性与兼容性
Toward Real-Time Edge AI: Model-Agnostic Task-Oriented Communication with Visual Feature Alignment
- 用共享锚点数据实现跨系统视觉特征对齐
- 服务器端通过线性变换估计,设备端用相对编码简化通信
- 支持不同服务商系统协作,适合实时边缘智能场景
任务导向通信通过优化学习模块以提取并传输相关任务信息,提升了边缘推理系统的通信效率。然而,实时应用面临边缘服务器覆盖不全或故障等问题,需不同推理系统间进行跨模型通信。独立优化导致特征空间不一致,阻碍了现有方法的跨模型推理。本文提出一种新框架,利用跨系统共享锚点数据,解决服务器端与设备端的特征对齐问题。针对服务器端,基于视觉特征的线性不变性,通过编码的锚点特征估计线性变换;针对设备端,利用视觉特征的角度保持特性,编码相对表示,实现无需额外对齐步骤的跨模型通信。在计算机视觉基准上的实验表明,该方法在跨模型任务导向通信中表现优异。运行时与计算开销分析进一步验证了其在实时应用中的有效性。
原文摘要 · Abstract (English)
Task-oriented communication presents a promising approach to improve the communication efficiency of edge inference systems by optimizing learning-based modules to extract and transmit relevant task information. However, real-time applications face practical challenges, such as incomplete coverage and potential malfunctions of edge servers. This situation necessitates cross-model communication between different inference systems, enabling edge devices from one service provider to collaborate effectively with edge servers from another. Independent optimization of diverse edge systems often leads to incoherent feature spaces, which hinders the cross-model inference for existing task-oriented communication. To facilitate and achieve effective cross-model task-oriented communication, this study introduces a novel framework that utilizes shared anchor data across diverse systems. This approach addresses the challenge of feature alignment in both server-based and on-device scenarios. In particular, by leveraging the linear invariance of visual features, we propose efficient server-based feature alignment techniques to estimate linear transformations using encoded anchor data features. For on-device alignment, we exploit the angle-preserving nature of visual features and propose to encode relative representations with anchor data to streamline cross-model communication without additional alignment procedures during the inference. The experimental results on computer vision benchmarks demonstrate the superior performance of the proposed feature alignment approaches in cross-model task-oriented communications. The runtime and computation overhead analysis further confirm the effectiveness of the proposed feature alignment approaches in real-time applications.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。