让单目深度模型聚焦用户指定区域,提升关键目标的精度与边界清晰度。
Focusable Monocular Depth Estimation

- 通过框/文本提示引导模型聚焦目标区域,实现区域感知的深度估计。
- 在25万张图像上验证,目标区域精度显著提升,全局几何保持一致。
- 适合需要精准局部深度的机器人导航、虚拟现实等场景使用。
单目深度基础模型虽具备跨场景泛化能力,但通常采用均匀像素级优化目标,无法区分用户指定或任务相关的重点区域与上下文。为此,我们提出可聚焦的单目深度估计(FDE),要求模型在给定目标区域时,优先保证前景深度准确性、保留清晰边界过渡,并维持连贯的全局场景结构。为此,我们提出FocusDepth框架,一种基于提示的单目相对深度估计方法,通过框或文本提示引导模型聚焦目标区域。其核心多尺度空间对齐融合(MSSA)将Segment Anything Model 3与Depth Anything系列的多尺度特征进行空间对齐,并通过尺度特定的门控条件融合注入提示信息,实现密集提示引导而不破坏几何结构,赋予模型聚焦感知能力。为研究FDE,我们构建了FDE-Bench,一个以目标为中心的单目相对深度基准,涵盖五个数据集共252.9K/72.5K训练/验证图像-目标-深度三元组,覆盖972个类别,包含真实世界与具身仿真环境。在该基准上,FocusDepth在框和文本提示下均持续优于全局微调的DA2/DA3基线,尤其在目标边界和前景区域提升显著,同时保持全局几何一致性。消融实验表明,MSSA的空间对齐是关键设计,破坏提示-几何对应关系会使AbsRel上升达13.8%。
原文摘要 · Abstract (English)
Monocular depth foundation models generalize well across scenes, yet they are typically optimized with uniform pixel-wise objectives that do not distinguish user-specified or task-relevant target regions from the surrounding context. We therefore introduce Focusable Monocular Depth Estimation (FDE), a region-aware depth estimation task in which, given a specified target region, the model is required to prioritize foreground depth accuracy, preserve sharp boundary transitions, and maintain coherent global scene geometry. To prioritize task-critical region modeling, we propose FocusDepth, a prompt-conditioned monocular relative depth estimation framework that guides depth modeling to focus on target regions via box/text prompts. The core Multi-Scale Spatial-Aligned Fusion (MSSA) in FocusDepth spatially aligns multi-scale features from Segment Anything Model 3 to the Depth Anything family and injects them through scale-specific, gated conditional fusion. This enables dense prompt cue injection without disrupting geometric representations, thereby endowing the depth estimation model with focused perception capability. To study FDE, we establish FDE-Bench, a target-centric monocular relative depth benchmark built from image-target-depth triplets across five datasets, containing 252.9K/72.5K train/val triplets and 972 categories spanning real-world and embodied simulation environments. On FDE-Bench, FocusDepth consistently improves over globally fine-tuned DA2/DA3 baselines under both box and text prompts, with the largest gains appearing in target boundary and foreground regions while preserving global scene geometry. Ablations show that MSSA's spatial alignment is the key design factor, as disrupting prompt-geometry correspondence increases AbsRel by up to 13.8%.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。