arXiv:2412.08096cs.RO2024-12被引 3

清华发布大规模动态室内场景数据集,助力机器人在复杂环境下的感知与导航研究。

THUD++: Large-Scale Dynamic Indoor Scene Dataset and Benchmark for Mobile Robots

  • 融合真实与仿真数据,构建13个大型动态室内场景
  • 包含90,000+帧RGB-D图像和2000万级2D/3D标注框
  • 适合机器人感知、轨迹预测与导航算法测试

现有移动机器人数据集多聚焦静态场景,难以评估动态环境下的性能。为此,我们推出了面向移动机器人的大规模室内动态场景数据集THUD++(TsingHua University Dynamic)。当前数据集包含13个大型动态场景,结合真实机器人平台与物理仿真平台采集的真实与合成数据。RGB-D数据集包含超过90,000帧图像、2000万条2D/3D边界框(含静态与动态物体)、相机位姿及IMU数据;轨迹数据集涵盖6,000+名行人在室内场景中的轨迹。数据集还集成基于Unity3D的仿真平台,支持自定义场景构建与算法测试。我们在THUD++上评估了主流方法在3D目标检测、语义分割、重定位、行人轨迹预测与导航等任务上的表现,揭示了机器人在复杂、拥挤动态环境中面临的关键挑战。通过共享该数据集,我们旨在推动移动机器人算法的研发与验证,促进实际应用落地。

原文摘要 · Abstract (English)

Most existing mobile robotic datasets primarily capture static scenes, limiting their utility for evaluating robotic performance in dynamic environments. To address this, we present a mobile robot oriented large-scale indoor dataset, denoted as THUD++ (TsingHua University Dynamic) robotic dataset, for dynamic scene understanding. Our current dataset includes 13 large-scale dynamic scenarios, combining both real-world and synthetic data collected with a real robot platform and a physical simulation platform, respectively. The RGB-D dataset comprises over 90K image frames, 20M 2D/3D bounding boxes of static and dynamic objects, camera poses, and IMU. The trajectory dataset covers over 6,000 pedestrian trajectories in indoor scenes. Additionally, the dataset is augmented with a Unity3D-based simulation platform, allowing researchers to create custom scenes and test algorithms in a controlled environment. We evaluate state-of-the-art methods on THUD++ across mainstream indoor scene understanding tasks, e.g., 3D object detection, semantic segmentation, relocalization, pedestrian trajectory prediction, and navigation. Our experiments highlight the challenges mobile robots encounter in indoor environments, especially when navigating in complex, crowded, and dynamic scenes. By sharing this dataset, we aim to accelerate the development and testing of mobile robot algorithms, contributing to real-world robotic applications.

机器人感知动态场景数据集3D理解

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。