面向低轨卫星的半监督分层学习框架,解决数据标注难与连接不稳问题。
LEO-Split: A Semi-Supervised Split Learning Framework over LEO Satellite Networks
- 用半监督学习缓解标签数据稀缺,结合辅助模型应对卫星与地面站断连时的训练失败。
- 通过伪标签算法纠正各卫星间的数据分布差异,提升整体训练效果。
- 设计自适应激活插值机制,防止地面站端子模型过拟合,适合资源受限的星载场景。
近年来,低轨(LEO)卫星系统的广泛部署推动了空间分析(如农作物和气候监测)的发展,这高度依赖于深度学习(DL)的进步。然而,LEO卫星与地面站(GS)之间的间歇性连接严重阻碍了原始数据向地面站的及时传输,以进行集中式学习;同时,日益庞大的深度学习模型又难以在资源受限的卫星上实现分布式学习。尽管分层学习(SL)可通过模型分割并将主要训练任务卸载至地面站来缓解这些问题,但人工标注成本高,加上连接不稳定和数据异构性,仍是主要挑战。本文提出 LEO-Split,一种专为卫星网络设计的半监督(SS)分层学习框架,以应对上述难题。利用半监督学习应对标签数据稀缺,构建辅助模型以解决卫星-地面站非接触时段的训练失败问题;提出伪标签算法修正卫星间的数据不平衡;设计自适应激活插值方案,防止地面站端子模型训练过拟合。基于真实卫星轨迹数据(如 Starlink)的大量实验表明,本框架性能优于现有先进基准。
原文摘要 · Abstract (English)
Recently, the increasing deployment of LEO satellite systems has enabled various space analytics (e.g., crop and climate monitoring), which heavily relies on the advancements in deep learning (DL). However, the intermittent connectivity between LEO satellites and ground station (GS) significantly hinders the timely transmission of raw data to GS for centralized learning, while the scaled-up DL models hamper distributed learning on resource-constrained LEO satellites. Though split learning (SL) can be a potential solution to these problems by partitioning a model and offloading primary training workload to GS, the labor-intensive labeling process remains an obstacle, with intermittent connectivity and data heterogeneity being other challenges. In this paper, we propose LEO-Split, a semi-supervised (SS) SL design tailored for satellite networks to combat these challenges. Leveraging SS learning to handle (labeled) data scarcity, we construct an auxiliary model to tackle the training failure of the satellite-GS non-contact time. Moreover, we propose a pseudo-labeling algorithm to rectify data imbalances across satellites. Lastly, an adaptive activation interpolation scheme is devised to prevent the overfitting of server-side sub-model training at GS. Extensive experiments with real-world LEO satellite traces (e.g., Starlink) demonstrate that our LEO-Split framework achieves superior performance compared to state-ofthe-art benchmarks.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。