arXiv:2605.09802cs.CVcs.AI2026-05中稿 · CVPR

解决视觉语言模型在不同视角间检测性能下降的问题

CrossVL: Complexity-Aware Feature Routing and Paired Curriculum for Cross-View Vision-Language Detection

论文配图:CrossVL: Complexity-Aware Feature Routing and Paired Curriculum for Cross-View Vision-Language Detection
图 1 · 摘自论文原文
  • 根据场景复杂度动态路由视觉特征,生成视图特异性表示
  • 在MAVREC数据集上使Florence-2的空中检测mAP提升至61.03%
  • 适合需要跨视角鲁棒检测的应用场景

视觉语言模型(VLM)虽能实现文本引导的目标检测,但在地面与航拍视角差异显著时性能严重下降。由于高程、尺度和空间布局不同,导致视角间存在系统性复杂度差异:地面图像结构密集且高度遮挡,航拍图像则稀疏且全局组织。固定融合机制无法应对此差异。本文提出CrossVL框架,结合复杂度感知路径聚合(CPA)与成对课程学习(PCL)。CPA通过多模态统计估计场景复杂度,将视觉特征路由至多条路径以获得视图特定表示;PCL利用同步地面-航拍图像对的语义一致性提供稳定早期监督,随后逐步转向随机采样。在MAVREC数据集上,CrossVL将Florence-2的航拍mAP从58.66%提升至61.03%,地面-航拍性能差距由8.63个百分点降至6.65个百分点,且随机种子间方差减少3.3倍。CPA实现稳定复杂度感知特征聚合,PCL优化训练动态。二者协同表明,架构与训练策略的协调适配对跨视角VLM检测至关重要。

原文摘要 · Abstract (English)

Vision-language models (VLMs) enable text-guided object detection but degrade severely under cross-view scenarios where ground and aerial viewpoints differ in altitude, scale, and spatial layout. These geometric changes introduce systematic complexity variations between viewpoints, e.g., ground view images contain dense and highly occluded structures, while aerial images are sparse and globally organized. Fixed VLM fusion mechanisms cannot handle this discrepancy. We propose CrossVL, a framework combining Complexity-Aware Pathway Aggregation (CPA) and Paired Curriculum Learning (PCL) for enhanced cross-view detection for VLM. CPA estimates scene complexity from multimodal statistics and routes visual features through multiple pathways to obtain view-specific representations. PCL leverages semantic consistency of synchronized ground-aerial pairs to provide stable early supervision and then gradually shifts toward randomized sampling. On MAVREC, CrossVL improves Florence-2's aerial mAP from 58.66% to 61.03% and reduces the ground-aerial performance gap from 8.63pp to 6.65pp, while also achieving a 3.3x reduction in variance across random seeds. CPA provides stable complexity-aware feature aggregation, and PCL enhances optimization dynamics. Together, they demonstrate that coordinated architectural and training adaptations are crucial for robust cross-view VLM detection.

跨视角检测视觉语言模型复杂度感知课程学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。