arXiv:2605.07562cs.CV2026-05被引 1

让遥感模型根据地面采样距离动态调整推理路径,提升跨尺度识别能力。

Beyond GSD-as-Token: Continuous Scale Conditioning for Remote Sensing VLMs

论文配图:Beyond GSD-as-Token: Continuous Scale Conditioning for Remote Sensing VLMs
图 1 · 摘自论文原文
  • 将地面采样距离作为连续变量调控模型计算路径,取代离散标签。
  • 在150万样本数据集上训练,多个遥感基准测试达到最优性能。
  • 无需传感器元数据即可自预测分辨率,适合实际部署场景。

遥感视觉语言模型(RS-VLMs)与自然图像模型存在根本性差异:同一地理对象在不同地面采样距离(GSD)下呈现截然不同的视觉特征,跨越多个数量级。现有方法通常忽略GSD或将其作为离散文本标记,迫使单一静态参数集适应全尺度范围。我们提出ScaleEarth,一个基于Qwen3-VL的参数高效微调框架,将GSD视为连续条件变量,控制模型计算路径。核心为CS-HLoRA(连续尺度条件超低秩适配器),通过GSD驱动门控调节低秩子空间,实现按物理尺度动态路由计算。为避免部署时依赖传感器元数据,我们结合SSE-U——一个轻量级异方差子头,可从视觉特征中预测GSD及其不确定性。为提供匹配监督,构建了包含150万样本的GeoScale-VQA数据集,其问答生成受相同物理标量驱动,形成闭环方法-数据循环。在80亿参数骨干网络上使用QLoRA训练,ScaleEarth在涵盖多种地球系统任务的遥感基准(如XLRS-Bench和OmniEarth-Bench)上取得当前最优表现。

原文摘要 · Abstract (English)

Remote sensing vision-language models (RS-VLMs) face a fundamental mismatch with natural-image counterparts: the same geographic object exhibits radically different visual evidence across ground sampling distances (GSDs) spanning multiple orders of magnitude. Yet existing RS-VLMs often discard GSD or inject it as a discrete text token, forcing a single static parameter set to absorb the entire scale spectrum. We introduce ScaleEarth, a parameter-efficient fine-tuning framework built on Qwen3-VL that treats GSD as a continuous conditioning variable governing the model's computation path. At its core, CS-HLoRA (Continuous Scale-Conditioned Hyper-LoRA) modulates the LoRA low-rank subspace through a GSD-driven gate, enabling the model to dynamically route computation by physical scale. To remove reliance on sensor metadata at deployment, we pair CS-HLoRA with SSE-U, a lightweight heteroscedastic sub-head that predicts GSD and its uncertainty from visual features. To provide matching supervision, we construct GeoScale-VQA, a 1.5M-sample scale-layered RS-VQA corpus whose question-answer generation is conditioned on the same physical scalar that drives CS-HLoRA, forming a closed method-data loop. Trained with QLoRA on an 8B backbone, ScaleEarth achieves state-of-the-art results on remote-sensing benchmarks covering diverse Earth-system tasks, including XLRS-Bench and OmniEarth-Bench.

遥感多尺度视觉语言模型参数高效

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。