arXiv:2603.27797cs.RO2026-03

根据输入图像自动选最优3D重建模型,兼顾精度与计算成本。

Which Reconstruction Model Should a Robot Use? Routing Image-to-3D Models for Cost-Aware Robotic Manipulation

  • 分离视点依赖模型性能与图像难易度,动态路由选择
  • 在多个数据集上优于现有基线,支持灵活成本约束
  • 适合需要快速响应的机器人抓取与精细操作场景

机器人操作需不同质量的3D网格重建:灵巧操作需高细节表面,避障规划可接受粗略表示。多种重建方法提供不同成本-质量权衡,从依赖视角的图像到3D模型,到视图无关的结构光扫描。全部查询模型计算开销大,促使按输入选择模型。我们提出SCOUT,一种新型路由框架,将重建评分解耦为两部分:(1) 视点依赖模型的相对性能,由学习的概率分布捕捉;(2) 图像整体难度,由标量分区函数估计。学习网络仅作用于视点依赖模型,视图无关流程可增删或重构而无需重训练。SCOUT还支持推理时任意成本约束,适配机器人中常见的多维成本限制。我们在Google Scanned Objects、BigBIRD和YCB数据集上,使用多种网格质量指标评估,证明其在各种成本约束下持续优于基于大语言模型文献调整的路由基线。进一步通过机器人抓取和灵巧操作实验验证框架有效性。代码与附加结果已发布于官网。

原文摘要 · Abstract (English)

Robotic manipulation tasks require 3D mesh reconstructions of varying quality: dexterous manipulation demands fine-grained surface detail, while collision-free planning tolerates coarser representations. Multiple reconstruction methods offer different cost-quality tradeoffs, from Image-to-3D models - whose output quality depends heavily on the input viewpoint - to view-invariant methods such as structured light scanning. Querying all models is computationally prohibitive, motivating per-input model selection. We propose SCOUT, a novel routing framework that decouples reconstruction scores into two components: (1) the relative performance of viewpoint-dependent models, captured by a learned probability distribution, and (2) the overall image difficulty, captured by a scalar partition function estimate. As the learned network operates only over the viewpoint-dependent models, view-invariant pipelines can be added, removed, or reconfigured without retraining. SCOUT also supports arbitrary cost constraints at inference time, accommodating the multi-dimensional cost constraints common in robotics. We evaluate on the Google Scanned Objects, BigBIRD, and YCB datasets under multiple mesh quality metrics, demonstrating consistent improvements over routing baselines adapted from the LLM literature across various cost constraints. We further validate the framework through robotic grasping and dexterous manipulation experiments. We release the code and additional results on our website.

3D重建机器人模型路由成本优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。