FlightAR通过多路视频与AR叠加，提升无人机操控的环境感知能力。
FlightAR: AR Flight Assistance Interface with Multiple Video Streams and Object Detection Aimed at Immersive Drone Control
- 融合无人机前视与底视视频流，通过头显实现双视角实时增强显示。
- 用户测试显示物理负荷低（μ=1.8），任务表现好（μ=3.4），体验评分高。
- 适合需要高沉浸感与环境感知的无人机操作员，尤其适用于复杂场景飞行。
无人机技术的快速发展对人机交互界面提出了新要求。现有第一人称视角（FPV）眼镜等接口限制了操作者对环境信息的获取。本文提出新型界面 FlightAR，将无人机前视与底部摄像头视频流通过头戴式显示器（HMD）进行增强现实（AR）叠加，提升飞行员的情境意识。该系统支持多路摄像头视频同步显示，并实现实时环境观测。基于 NASA-TLX 和 UEQ 的用户评估显示，系统物理负担低（μ=1.8，SD=0.8），任务表现良好（μ=3.4，SD=0.8），显著优于基线 FPV 眼镜。参与者在刺激性（μ=2.35）、新颖性（μ=2.1）和吸引力（μ=1.97）方面评分较高，表明用户体验积极。结果证明，该系统通过增强情境感知与直观控制，具有提升无人机操控体验的潜力。代码已开源：https://github.com/Sautenich/FlightAR
原文摘要 · Abstract (English)
The swift advancement of unmanned aerial vehicle (UAV) technologies necessitates new standards for developing human-drone interaction (HDI) interfaces. Most interfaces for HDI, especially first-person view (FPV) goggles, limit the operator's ability to obtain information from the environment. This paper presents a novel interface, FlightAR, that integrates augmented reality (AR) overlays of UAV first-person view (FPV) and bottom camera feeds with head-mounted display (HMD) to enhance the pilot's situational awareness. Using FlightAR, the system provides pilots not only with a video stream from several UAV cameras simultaneously, but also the ability to observe their surroundings in real time. User evaluation with NASA-TLX and UEQ surveys showed low physical demand ($μ=1.8$, $SD = 0.8$) and good performance ($μ=3.4$, $SD = 0.8$), proving better user assessments in comparison with baseline FPV goggles. Participants also rated the system highly for stimulation ($μ=2.35$, $SD = 0.9$), novelty ($μ=2.1$, $SD = 0.9$) and attractiveness ($μ=1.97$, $SD = 1$), indicating positive user experiences. These results demonstrate the potential of the system to improve UAV piloting experience through enhanced situational awareness and intuitive control. The code is available here: https://github.com/Sautenich/FlightAR
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品；中文卡片由大模型生成，请以原文为准。