提出轻量级视频处理框架,让无人机实时识别洪水范围
Efficient On-Board Processing of Oblique UAV Video for Rapid Flood Extent Mapping
- 利用视频时空冗余,复用静态区域特征避免重复计算
- 在边缘设备上降低30%推理延迟,精度损失小于0.5% mIoU
- 适合应急响应、洪水监测等对时效性要求高的无人机任务
高效灾情响应依赖快速获取信息,倾斜航拍视频因能最大化覆盖范围且提升态势感知,成为灾后初期勘查的首选。然而,高分辨率倾斜视频的机载处理受限于无人机严格的尺寸、重量与功耗(SWaP)约束,其高计算密度难以在标准边缘硬件上实现低延迟推理。为此,本文提出时间令牌复用(TTR)框架,通过将图像块视为令牌,利用轻量相似度度量动态识别静态区域,并传播预计算深度特征,跳过冗余主干网络计算。我们在标准基准和新构建的倾斜洪水数据集(Oblique Floodwater Dataset)上验证该方法。实验表明,在边缘级硬件上,TTR实现30%推理延迟降低,分割精度损失低于0.5% mIoU。结果证实TTR有效拓展了操作帕累托前沿,支持高保真、实时的倾斜视频理解,适用于时间敏感的遥感任务。
原文摘要 · Abstract (English)
Effective disaster response relies on rapid disaster response, where oblique aerial video is the primary modality for initial scouting due to its ability to maximize spatial coverage and situational awareness in limited flight time. However, the on-board processing of high-resolution oblique streams is severely bottlenecked by the strict Size, Weight, and Power (SWaP) constraints of Unmanned Aerial Vehicles (UAVs). The computational density required to process these wide-field-of-view streams precludes low-latency inference on standard edge hardware. To address this, we propose Temporal Token Reuse (TTR), an adaptive inference framework capable of accelerating video segmentation on embedded devices. TTR exploits the intrinsic spatiotemporal redundancy of aerial video by formulating image patches as tokens; it utilizes a lightweight similarity metric to dynamically identify static regions and propagate their precomputed deep features, thereby bypassing redundant backbone computations. We validate the framework on standard benchmarks and a newly curated Oblique Floodwater Dataset designed for hydrological monitoring. Experimental results on edge-grade hardware demonstrate that TTR achieves a 30% reduction in inference latency with negligible degradation in segmentation accuracy (< 0.5% mIoU). These findings confirm that TTR effectively shifts the operational Pareto frontier, enabling high-fidelity, real-time oblique video understanding for time-critical remote sensing missions
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。