构建真实实验室透明生物器皿多视角数据集,助力机器人视觉感知。
TransBiolab: A Real-World Multi-View Dataset of Cluttered Transparent Biomedical Objects

- 采集98个场景的多视角RGB-D序列,覆盖15类透明器皿。
- 包含161,315帧与103万实例标注,支持6D姿态等任务评估。
- 专为复杂遮挡与多视角场景设计,适合机器人操作研究者使用。
自主生物实验室日益依赖视觉感知来识别、定位并操作透明塑料器皿,但高质量的真实世界数据集仍十分有限。现有透明物体数据集虽已推进分割、深度和位姿估计,却很少在多物体杂乱、相互遮挡及校准多视角采集等真实实验操作场景下进行综合评估。为此,我们提出TransBiolab,一个真实世界中的多视角RGB-D数据集,涵盖杂乱透明生物器皿的校准多视图序列。该数据集包含98个场景的161,315帧图像,共103万实例标注,覆盖15类实验室物体,包括6D位姿、完整与可见掩码、深度图及每帧相机标定信息。数据按物体类别、单帧物体总数和摄像机视角三个维度组织,反映实际操作难度。我们还定义了面向分割、深度估计与补全、6D位姿估计的基准测试,并基于释放的标注与标定信息实现了系统级机器人操作评估。通过聚焦重复透明实例、杂乱环境与多视角采集,TransBiolab为自主实验室操作中的分割、深度估计、6D位姿估计与多视角推理提供了关键资源。
原文摘要 · Abstract (English)
Autonomous biomedical laboratories increasingly rely on visual perception to recognize, localize, and manipulate transparent plasticware, yet high-quality real-world datasets for this setting remain limited. The scarcity of domain-relevant data is particularly restrictive in cluttered multi-object scenes, where mutual occlusion and view-dependent appearance changes remain challenging even for contemporary visual foundation models. Existing transparent-object datasets have advanced segmentation, depth, and pose estimation, but they usually do not evaluate the combined setting of multi-object clutter, occlusion, and calibrated multi-view capture that characterizes real laboratory manipulation scenes. To address this gap, we present TrainsBiolab, a real-world RGB-D dataset of cluttered transparent biomedical objects captured as calibrated multi-view sequences. TrainsBiolab contains 161,315 frames from 98 scenes and 1.03M instance annotations over 15 laboratory object types, including 6D poses, full and visible masks, depth, and per-frame camera calibration. The dataset is organized along three axes that reflect operational difficulty: object category, the total number of objects in a frame, and camera viewpoint. We further define dataset-centric benchmarks for segmentation, depth estimation and completion, and 6D pose estimation, and report a system-level robot manipulation evaluation enabled by the released annotations and calibrations. By focusing on repeated transparent instances, clutter, and multi-view laboratory capture, TrainsBiolab provides a resource for segmentation, depth estimation, 6D pose estimation, and multi-view reasoning in autonomous laboratory manipulation. Project page: https://dualtransparency.github.io/TransBiolab/.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。