arXiv:2605.24014cs.CV2026-05

多无人机协作实现野外实时语义分割,提升精度与效率。

SkySeg: Collaborative Onboard Semantic Segmentation with Heterogeneous UAVs in the Wild

论文配图:SkySeg: Collaborative Onboard Semantic Segmentation with Heterogeneous UAVs in the Wild
图 1 · 摘自论文原文
  • 多机协同融合高低分辨率图像,优化资源受限平台的推理
  • 实测推理延迟降低3.6倍,野外平均准确率提升10.91%
  • 适用于复杂环境下的实时遥感分析,适合无人机群组应用

基于无人机的图像采集与分析需求激增,无人机在语义分割任务中广泛应用。为满足遥感任务对实时分析的要求,将计算与决策部署在机上是自然选择。然而,在资源受限的无人机平台上部署语义分割面临两大挑战:1)硬件限制导致难以实现实时分割;2)飞行中环境变化引发数据分布偏移,偏离原始训练数据。为此,本文提出SkySeg,一种异构多无人机空中协同框架,结合计算机视觉与飞行模式,利用低成本传感器实现机上语义分割。SkySeg采用高效的多源信息融合推理方法,融合低分辨率广域图像与高分辨率聚焦图像;同时引入跨设备测试时自适应(TTA)策略,通过多机协同缓解测试数据流的分布偏移问题。实验表明,该框架使推理延迟降低约3.6倍,机上分割精度提升5.91%,在野外环境下平均准确率提升10.91%。

原文摘要 · Abstract (English)

The demand for unmanned aerial vehicle (UAV)-based image acquisition and analysis has surged, with UAVs increasingly utilized for semantic segmentation tasks. To meet the real-time analysis requirements of UAV remote sensing missions, performing onboard computation and making decisions based on the results is a natural approach. However, deploying semantic segmentation on resource-constrained UAV platforms presents two significant challenges: 1) hardware constraints limit the ability of UAVs to perform real-time semantic segmentation, and 2) environmental variations during flight cause data distribution shifts, deviating from the original training data. To address these issues, this paper introduces SkySeg, a heterogeneous multi-UAV air-air cooperation framework that integrates computer vision and flight pattern to enable onboard semantic segmentation using low-cost sensors. SkySeg employs an efficient information fusion inference method, combining low-definition, wide-area images with high-definition, focused-area images. Additionally, it incorporates a cross-device test-time adaptation (TTA) strategy to enhance segmentation performance in dynamic environments by collaboratively addressing distribution shifts of test data streams across UAVs. Experimental results demonstrate that our SkySeg framework accelerates inference latency by approximately 3.6x, improves onboard segmentation accuracy by 5.91\%, and achieves a 10.91\% average accuracy gain in the wild.

无人机语义分割多机协同实时推理

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。