构建跨平台与场景的无人机导航评估基准,揭示性能受硬件与环境双重影响。
FLYINGTRUST: A Benchmark for Quadrotor Navigation Across Scenarios and Vehicles
- 用推重比和角加速度两个物理指标表征飞行器能力
- 在真实与虚拟平台间测试,发现算法表现随平台与场景变化有规律可循
- 适合无人机算法研发者与系统集成方用于早期可靠性评估
多旋翼无人机视觉导航算法在不同飞行平台和场景结构间迁移时性能波动大,增加部署成本与风险。为支持系统性早期评估,我们提出FLYINGTRUST——一个高保真、可配置的基准框架,用于衡量平台动力学特性与场景结构对导航鲁棒性的联合影响。该框架采用两个紧凑且具物理意义的指标:最大推重比和轴向最大角加速度,来建模飞行器能力。基准配套多样场景库与异构真实及虚拟平台,并制定标准化评估协议与复合评分方法,兼顾场景重要性、平台重要性与性能稳定性。我们使用FLYINGTRUST在相同条件下对比代表性优化与学习类导航方法,对每组平台-场景组合进行重复试验,报告不确定性感知指标。结果揭示系统性规律:导航成功率可预测地依赖于平台能力与场景几何,不同算法在各类条件中表现出独特偏好与失效模式。这些发现强调将平台能力与场景结构纳入算法设计、评估与选型的必要性,并推动未来研究开发跨平台与场景保持鲁棒的方法。
原文摘要 · Abstract (English)
Visual navigation algorithms for quadrotors often exhibit a large variation in performance when transferred across different vehicle platforms and scene geometries, which increases the cost and risk of field deployment. To support systematic early-stage evaluation, we introduce FLYINGTRUST, a high-fidelity, configurable benchmarking framework that measures how platform kinodynamics and scenario structure jointly affect navigation robustness. FLYINGTRUST models vehicle capability with two compact, physically interpretable indicators: maximum thrust-to-weight ratio and axis-wise maximum angular acceleration. The benchmark pairs a diverse scenario library with a heterogeneous set of real and virtual platforms and prescribes a standardized evaluation protocol together with a composite scoring method that balances scenario importance, platform importance and performance stability. We use FLYINGTRUST to compare representative optimization-based and learning-based navigation approaches under identical conditions, performing repeated trials per platform-scenario combination and reporting uncertainty-aware metrics. The results reveal systematic patterns: navigation success depends predictably on platform capability and scene geometry, and different algorithms exhibit distinct preferences and failure modes across the evaluated conditions. These observations highlight the practical necessity of incorporating both platform capability and scenario structure into algorithm design, evaluation, and selection, and they motivate future work on methods that remain robust across diverse platforms and scenarios.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。