让边缘设备智能融合多传感器数据,实时省电降延迟。
FusionSense: Tri-Stage Near-Sensor Learning for Runtime-Adaptive Multimodal Edge Intelligence

- 三阶段训练轻量近感分类器,动态判断各模态必要性
- 在30%数据压缩下质量损失减少92.3%,能耗最高降33倍
- 适合自动驾驶、工业物联网等资源受限的多模态场景
自主系统与智能制造部署越来越依赖近传感器、边缘和云端协同计算,但能源、延迟和可靠性预算紧张,要求运行时自适应。实际中,决定何时计算与传输至关重要;然而随着摄像头、激光雷达/深度等多模态传感器普及,现有方法要么在强大服务器上融合模态,要么采用忽略跨模态依赖的单模态近感过滤,导致冗余传输或漏检事件。我们提出FusionSense,一种面向能耗受限的自主边缘系统的融合感知框架。通过三步训练:(i) 服务端融合模型学习下游任务;(ii) 过滤安全(FoS)标签量化每种模态相对于融合决策的必要性;(iii) 边缘端融合模型通过注入近感预测作为辅助信号进行压缩。结果是一个运行时决策层,在线性扩展传感器数量的同时,联合降低计算与通信开销。在双模态(RGB+深度/激光雷达)的SynDrone设置下,FusionSense在显著更高的数据压缩率下保持任务质量,相较单模态滤波器实现大幅端到端提升:在1%误报率密度下能耗降低33倍,10%时降低11倍,在固定30%数据压缩下质量损失减少92.3%,能量节省约1.5倍于最优先前基线。
原文摘要 · Abstract (English)
Autonomous systems and smart-industry deployments increasingly split computation across near-sensor, edge, and cloud resources, where tight energy, latency, and reliability budgets demand run-time adaptivity. In practice, deciding what to compute and transmit at each point is pivotal; yet as multimodal sensor suites (cameras, LiDAR/depth, etc.) proliferate at the edge, most prior approaches either (i) fuse modalities on powerful servers or (ii) apply uni-modal near-sensor filters that ignore cross-modal dependencies, leading to redundant transmissions or missed events. We present FusionSense, a fusion-aware intelligent sensing framework for energy-constrained autonomous edge systems. Lightweight near-sensor classifiers are trained via a three-step procedure: (i) a server-side fusion model learns the downstream task, (ii) filter-out-safe (FoS) labels quantify each modality's necessity relative to the fused decision, and (iii) an edge-side fusion model is compacted by injecting near-sensor predictions as auxiliary signals. The result is a run-time decision layer that jointly reduces compute and communication while scaling linearly with sensor count. On a dual-modality (RGB+Depth/LiDAR) setup with SynDrone, FusionSense sustains task quality at substantially higher data-reduction rates than uni-modal filters and delivers large end-to-end gains: up to 33x lower energy at 1% FoI prevalence, 11x at 10%, a 92.3% reduction in quality loss at a fixed 30% data reduction, and roughly 1.5x higher energy savings than the best prior filtering baseline.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。