无需人工标注,融合视觉与事件信息预测无人机长期3D轨迹
Label-Free Long-Horizon 3D UAV Trajectory Prediction via Motion-Aligned RGB and Event Cues
- 用无监督方法从点云提取轨迹,通过运动一致性对齐图像生成伪标签
- 自监督融合运动模型与视觉Mamba网络,5秒内3D误差降低40%
- 适用于城市复杂场景的实时反无人机系统,无需昂贵标注成本
消费级无人机的普及给空域安全和公共安全带来严峻挑战。其高机动性和不可预测运动使追踪与拦截困难。现有方法多聚焦于当前位置检测,而多数反无人机策略依赖未来轨迹预测,需超越被动探测。为此,本文提出一种基于视觉的无监督三维无人机轨迹预测方法。首先采用无监督技术从原始LiDAR点云中提取无人机轨迹,再通过运动一致性将轨迹与相机图像对齐,生成可靠伪标签;随后在自监督框架下结合运动学估计与视觉Mamba神经网络,预测未来轨迹。在具有挑战性的MMAUD数据集(含广角多模态传感器与城市动态飞行序列)上评估显示,该框架在长时程轨迹预测上优于纯图像监督及音视频基线模型,5秒3D误差降低约40%,且未使用任何人工3D标注。所提系统为实时反无人机部署提供了低成本、可扩展的解决方案。代码将在论文接受后公开,以支持机器人领域的可复现研究。
原文摘要 · Abstract (English)
The widespread use of consumer drones has introduced serious challenges for airspace security and public safety. Their high agility and unpredictable motion make drones difficult to track and intercept. While existing methods focus on detecting current positions, many counter-drone strategies rely on forecasting future trajectories and thus require more than reactive detection to be effective. To address this critical gap, we propose an unsupervised vision-based method for predicting the three-dimensional trajectories of drones. Our approach first uses an unsupervised technique to extract drone trajectories from raw LiDAR point clouds, then aligns these trajectories with camera images through motion consistency to generate reliable pseudo-labels. We then combine kinematic estimation with a visual Mamba neural network in a self-supervised manner to predict future drone trajectories. We evaluate our method on the challenging MMAUD dataset, including the V2 sequences that feature wide-field-of-view multimodal sensors and dynamic UAV motion in urban scenes. Extensive experiments show that our framework outperforms supervised image-only and audio-visual baselines in long-horizon trajectory prediction, reducing 5-second 3D error by around 40 percent without using any manual 3D labels. The proposed system offers a cost-effective, scalable alternative for real-time counter-drone deployment. All code will be released upon acceptance to support reproducible research in the robotics community.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。