arXiv:2508.07555cs.LGcs.IT2025-08被引 4

多模态传感下优化数据时效性,显著降低机器学习推理误差。

Multimodal Remote Inference

  • 基于信息年龄建模多模态数据更新策略,构建可求解的决策框架。
  • 提出EAST算法,在五模态场景下推理误差降低44.8%。
  • 设计低复杂度策略,兼顾计算效率与精度,适合资源受限系统。

我们研究一种多模态远程推理系统,其中多模态机器学习(ML)模型利用来自远程传感器的特征进行实时推理。当传感器观测随时间动态变化时,新鲜特征对推理任务至关重要。然而,在网络资源受限情况下,及时传输所有模态特征往往不可行。为此,我们提出一个最小化ML模型推理误差的多模态调度问题。将误差建模为信息年龄(AoI)向量的通用函数,将问题转化为半马尔可夫决策过程(SMDP),并推导出状态空间缩减的等价形式。我们发现两模态与多模态情形具有根本不同的链结构:在两模态情况下,证明最优策略具有基于索引的阈值结构;在一般多模态情况(超过两模态),提出误差感知切换与传输策略(EAST),通过多链策略迭代算法(MPI)计算。为降低复杂度,还设计了两种简化策略:误差感知传输策略(EAT)和固定阈值策略(FT)。三个案例研究的数值结果表明,所提策略优于轮询、贪婪和均匀随机等简单启发式方法。尤其在五模态场景中,EAST相较最优基线误差降低达44.8%;而EAT与FT分别使计算时间减少6.6倍和3000倍,同时推理误差增加20.2%和38.6%。

原文摘要 · Abstract (English)

We consider a remote inference system with multiple modalities, where a multimodal machine learning (ML) model performs real-time inference using features collected from remote sensors. When sensor observations evolve dynamically over time, fresh features are critical for inference tasks. However, timely delivery of features from all modalities is often infeasible under limited network resources. To address this challenge, we formulate a multimodal scheduling problem to minimize the ML model's inference error. We model this error as a general function of the Age of Information (AoI) vector, where AoI quantifies data freshness. We cast the problem as a semi-Markov decision process (SMDP) and derive an equivalent reformulation with a reduced state set. We then show that the problem has fundamentally different chain structures in the two-modality and multi-modality cases. For the two-modality case, we prove that the optimal policy has an index-based threshold structure. For the general multi-modality case (i.e., with more than two modalities), we develop the optimal error-aware switching-and-transmission policy (EAST), which is computed using a multichain policy iteration algorithm (MPI). To further reduce complexity, we also develop two low-complexity policies under special settings: the error-aware transmission policy (EAT) and the fixed threshold policy (FT). Numerical results from three case studies show that the proposed policies outperform several simple heuristics, including round-robin, greedy, and uniform random policies. In particular, EAST reduces the inference error by up to 44.8% compared with the best baseline in each case. In the five-modality case, EAT and FT reduce computation time by 6.6$\times$ and 3000$\times$, respectively, relative to EAST, while increasing the inference error by 20.2% and 38.6%, respectively.

多模态远程推理信息年龄调度优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。