arXiv:2603.04249cs.RO2026-03

首个可线性组合光照的机器人操作数据集,支持真实与合成数据协同研究。

RoboLight: A Dataset with Linearly Composable Illumination for Robotic Manipulation

  • 构建可调控三维度光照的真实数据集,含2800个高清动态范围视频
  • 通过光照空间插值生成19.6万条合成数据,支持任意扩展
  • 适用于光照敏感任务研究,尤其适合机器人视觉与强化学习

本文提出RoboLight,首个在系统化光照变化下采集的机器人操作真实世界数据集。包含两部分:(a) RoboLight-Real由2800个真实实验组成,部署于自研光立方装置,配备八个可编程RGB LED灯,实现颜色、方向、强度三维度独立控制;每维配以不同几何与材质物体的任务,诱发感知挑战,所有图像以高动态范围(HDR)格式记录。基于光传输线性特性,(b) RoboLight-Synthetic通过在RoboLight-Real的HDR空间中插值得到196,000个合成实验;理论上可无限扩展。通过定性分析与真实策略部署验证数据质量,评估任务难度、分布多样性及合成数据有效性。同时展示三个典型应用场景。完整数据集、软硬件设计将开源,推动持续研究。

原文摘要 · Abstract (English)

In this paper, we introduce RoboLight, the first real-world robotic manipulation dataset capturing synchronized episodes under systematically varied lighting conditions. RoboLight consists of two components. (a) RoboLight-Real contains 2,800 real-world episodes collected in our custom Light Cube setup, a calibrated system equipped with eight programmable RGB LED lights. It includes structured illumination variation along three independently controlled dimensions: color, direction, and intensity. Each dimension is paired with a dedicated task featuring objects of diverse geometries and materials to induce perceptual challenges. All image data are recorded in high-dynamic-range (HDR) format to preserve radiometric accuracy. Leveraging the linearity of light transport, we introduce (b) RoboLight-Synthetic, comprising 196,000 episodes synthesized through interpolation in the HDR image space of RoboLight-Real. In principle, RoboLight-Synthetic can be arbitrarily expanded by refining the interpolation granularity. We further verify the dataset quality through qualitative analysis and real-world policy roll-outs, analyzing task difficulty, distributional diversity, and the effectiveness of synthesized data. We additionally demonstrate three representative use cases of the proposed dataset. The full dataset, along with the system software and hardware design, will be released as open-source to support continued research.

机器人操作光照建模数据集

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。