arXiv:2603.16307cs.AI2026-03中稿 · ECCV被引 2

构建大规模神经符号路线规划基准,评估遥感中感知、推理与规划能力。

NeSy-Route: A Neuro-Symbolic Benchmark for Constrained Route Planning in Remote Sensing

  • 融合高保真语义掩码与启发式搜索,自动生成带最优解的规划任务。
  • 涵盖10,821个样本,规模近此前最大基准的10倍,支持全面评估。
  • 三层次评测框架可精准分析感知、推理与规划表现,适合模型优化研究者。

遥感支撑灾害救援与生态调查等关键应用,系统需理解复杂场景与约束并做出可靠决策。现有遥感基准多聚焦多模态大语言模型(MLLM)的感知与推理能力,缺乏对规划能力的评估,原因在于规模化规划任务的构建与验证困难,以及评估协议不准确。为此,我们提出NeSy-Route,一个大规模神经符号遥感路径规划基准。该基准采用自动化数据生成框架,结合高保真语义掩码与启发式搜索,生成具有可证明最优解的多样化路径规划任务。NeSy-Route可全面评估10,821个路径规划样本,规模接近此前最大基准的10倍。同时,我们设计了三级分层神经符号评估协议,实现对感知、推理与规划能力的精准评估与细粒度分析。对多种先进MLLM的综合评估显示,当前模型在感知与规划能力上存在显著不足。我们希望NeSy-Route能推动更强大MLLM在遥感领域的研究与发展。数据集与代码已开源:https://mingyang1010.github.io/NeSy-Route/

原文摘要 · Abstract (English)

Remote sensing underpins crucial applications such as disaster relief and ecological field surveys, where systems must understand complex scenes and constraints and make reliable decisions. Current remote-sensing benchmarks mainly focus on evaluating perception and reasoning capabilities of multimodal large language models (MLLMs). They fail to assess planning capability, stemming either from the difficulty of curating and validating planning tasks at scale or from evaluation protocols that are inaccurate and inadequate. To address these limitations, we introduce NeSy-Route, a large-scale neuro-symbolic benchmark for constrained route planning in remote sensing. Within this benchmark, we introduce an automated data-generation framework that integrates high-fidelity semantic masks with heuristic search to produce diverse route-planning tasks with provably optimal solutions. This allows NeSy-Route to comprehensively evaluate planning across 10,821 route-planning samples, nearly 10 times larger than the largest prior benchmark. Furthermore, a three-level hierarchical neuro-symbolic evaluation protocol is developed to enable accurate assessment and support fine-grained analysis on perception, reasoning, and planning simultaneously. Our comprehensive evaluation of various state-of-the-art MLLMs demonstrates that existing MLLMs show significant deficiencies in perception and planning capabilities. We hope NeSy-Route can support further research and development of more powerful MLLMs for remote sensing. The dataset and code are available at https://mingyang1010.github.io/NeSy-Route/.

遥感路径规划神经符号基准测试

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。