arXiv:2605.26831cs.CVcs.RO2026-05

用提示生成场景,让语义地图评估更贴近真实操作需求

OSMa-Bench++: Toward Open-Ended Benchmarking of Semantic Mapping for Manipulation with Prompt-Generated Synthetic Scenes

论文配图:OSMa-Bench++: Toward Open-Ended Benchmarking of Semantic Mapping for Manipulation with Prompt-Generated Synthetic Scenes
图 1 · 摘自论文原文
  • 通过提示词自动合成室内场景,构建可控制的评估环境
  • 支持杂乱、小物体等12类操作难点测试,提升评估覆盖度
  • 适合机器人语义理解与场景推理研究者使用

语义映射方法正被广泛用于机器人推理与操作的中间表示,但现有评估仍依赖固定数据集,难以覆盖操作相关的边缘场景。本文扩展OSMa-Bench,通过提示词生成合成室内场景。其流程自动产生场景描述,利用SceneSmith合成环境,并通过语义归一化、材质修复、着色器回退策略、地板处理、导航设置和可控光照配置等中间层转换为OSMa-Bench兼容格式。关键优势在于原始提示词可作为场景的辅助语义标注,据此新增基于提示的问答类别。该框架支持在杂乱、小物体、部分遮挡、光照变化等条件下对语义地图进行定向压力测试,使评估更具可扩展性且更贴合下游操作需求。代码已开源。

原文摘要 · Abstract (English)

Semantic mapping methods are increasingly used as intermediate scene representations for downstream robotic reasoning and manipulation, yet their evaluation is still largely tied to fixed benchmark datasets with limited coverage of manipulation-relevant corner cases. In this work, we extend OSMa-Bench toward controllable benchmarking with prompt-generated synthetic indoor scenes. Our pipeline automatically generates scene descriptions, synthesizes corresponding environments with SceneSmith, and adapts the resulting assets into an OSMa-Bench-compatible simulation format. This adaptation requires a nontrivial intermediate layer, including semantic normalization, material and texture repair, shader fallback policies, floor handling, navigation setup, and controlled lighting configuration. A key advantage of the proposed setup is that the original scene-generation prompt is known in advance and can therefore serve as an auxiliary semantic specification of the intended scene. We use this property to extend the VQA component of OSMa-Bench with a prompt-grounded question category. The resulting framework supports targeted stress-testing of semantic scene representations under conditions such as clutter, small objects, partial occlusions, and lighting variation, and makes benchmarking more extensible and better aligned with downstream manipulation requirements. Our code is available at https://github.com/be2rlab/OSMa-Bench-v2.

语义映射机器人操作合成数据

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。