arXiv:2502.17235cs.ROcs.AI2025-02被引 2

用视觉评分引导搜索,自动整理桌面乱序物品。

Tidiness Score-Guided Monte Carlo Tree Search for Visual Tabletop Rearrangement

  • 用视觉判别器预测整洁度,评估任意摆放状态。
  • 无需预设目标,通过蒙特卡洛搜索找到多样整洁布局。
  • 在模拟与真实场景中验证,适用于多种桌面环境。

本文提出一种基于整洁度评分引导的蒙特卡洛树搜索(TSMCTS)框架,用于仅通过RGB-D相机解决桌面整理问题。针对当前缺乏公开数据集与基准、且难以定义未见物体目标配置两大挑战,我们构建了仿真生成的桌面整理(TTU)数据集,并训练了一个视觉判别器,可一致评估未见过的摆放状态(包括真实场景)的整洁程度。为解决目标配置设定难题,采用蒙特卡洛树搜索(MCTS)寻找整理路径,不依赖显式目标,仅以整洁度评分为引导,探索多样化整洁布局。实验表明,该框架在咖啡桌、餐桌、办公桌及浴室等多种环境中均表现良好。相关数据集已开源:https://github.com/rllab-snu/TTU-Dataset。

原文摘要 · Abstract (English)

In this paper, we present the tidiness score-guided Monte Carlo tree search (TSMCTS), a novel framework designed to address the tabletop tidying up problem using only an RGB-D camera. We address two major problems for tabletop tidying up problem: (1) the lack of public datasets and benchmarks, and (2) the difficulty of specifying the goal configuration of unseen objects. We address the former by presenting the tabletop tidying up (TTU) dataset, a structured dataset collected in simulation. Using this dataset, we train a vision-based discriminator capable of predicting the tidiness score. This discriminator can consistently evaluate the degree of tidiness across unseen configurations, including real-world scenes. Addressing the second problem, we employ Monte Carlo tree search (MCTS) to find tidying trajectories without specifying explicit goals. Instead of providing specific goals, we demonstrate that our MCTS-based planner can find diverse tidied configurations using the tidiness score as a guidance. Consequently, we propose TSMCTS, which integrates a tidiness discriminator with an MCTS-based tidying planner to find optimal tidied arrangements. TSMCTS has successfully demonstrated its capability across various environments, including coffee tables, dining tables, office desks, and bathrooms. The TTU dataset is available at: https://github.com/rllab-snu/TTU-Dataset.

桌面整理视觉评分强化学习仿真数据

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。