首个面向低空无人机的单目语义占据基准,让飞行更安全。
SkyShield: Occupancy as a Safety Interface for Low-Altitude UAV Autonomy

- 用单目摄像头和动态姿态数据构建低空占据感知新基准
- 提出考虑运动风险的KAR-mIoU评估指标,发现传统方法忽略的安全隐患
- 适合做低空无人机自主飞行、安全感知研究的团队使用
针对20米以下城市低空无人机自主飞行,现有数据集多为2D标注或车端3D框,无法反映无人机前视单目相机在动态6-DoF姿态下的真实飞行环境。为此,我们提出SkyShield,据知是首个面向低空无人机的前视单目语义占据基准。基于CARLA仿真,包含36,000帧多样城市场景与天气条件下的前视图像,每帧配以帧级6-DoF无人机位姿、动态相机外参、飞行状态及前视锥体语义占据标签。我们进一步提出KAR-mIoU评估指标,通过引入运动可达性与碰撞时间重加权,揭示传统mIoU掩盖的安全风险。为应对挑战,我们提出SkyOcc基线模型,融合帧级姿态信息、时序特征并引入安全优先优化,有效保留关键碰撞结构。三者共同确立占据为低空飞行的安全接口。代码与数据将公开。
原文摘要 · Abstract (English)
For low-altitude Unmanned Aerial Vehicle (UAV) autonomy, 3D spatial understanding is not merely a perception objective, but the safety interface between human instructions and physical flight. In human-scale urban airspace below 20 meters, thin geometry, occlusions, vegetation, and urban clutter define whether an aerial agent can safely enter the space ahead. However, existing UAV datasets mainly provide 2D annotations or 3D boxes, while driving-oriented occupancy benchmarks assume stable ground-level sensor rigs. Both miss the defining regime of low-altitude flight: a front-facing monocular camera observing occupied and free space from a moving aerial body with frame-wise changing 6-DoF pose and camera extrinsics. To bridge this gap, we introduce SkyShield, to the best of our knowledge the first front-view monocular semantic occupancy benchmark for urban UAV flight below 20 meters. Built on CARLA, SkyShield contains 36K front-view UAV samples across diverse urban scenes and weather conditions, pairing each image with frame-wise 6-DoF UAV pose, frame-wise dynamic camera geometry, UAV states, and front-frustum semantic occupancy labels. We further propose KAR-mIoU, a UAV-centric and dynamics-aware metric that re-weights voxel-level evaluation by kinematic reachability and time-to-collision, revealing safety-critical risks hidden by conventional mIoU. To tackle this challenging new setting, we provide SkyOcc, a geometry-first monocular baseline that integrates frame-wise UAV attitude into projection, fuses temporal occupancy features, and applies safety-prior optimization to preserve sparse collision-critical structures. Together, SkyShield, KAR-mIoU, and SkyOcc establish occupancy as a safety interface for low-altitude aerial autonomy. Code and dataset will be released publicly.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。