首个厨房场景下自然烹饪行为的立体事件相机数据集
Cooking beyond Frames: A Stereo Event Camera Dataset in the Kitchen

- 10人13厨房真实烹饪,无剧本动作,佩戴多传感器采集
- 5.5小时立体事件流,含同步RGB、深度与IMU数据
- 支持动作识别、目标检测等任务,推动类人日常场景研究
事件相机(又称神经形态相机)因高时间分辨率、高动态范围和低功耗近年备受关注。尽管已有大量面向自动驾驶与无人机的应用研究,但面向人类日常生活的事件视觉数据仍严重不足。现有少数事件数据集多采用预设动作,难以反映真实行为。本文提出EventKitchen,一个大规模、以第一视角采集的厨房烹饪活动立体事件相机数据集。10名参与者在13个不同厨房中自然进行烹饪,佩戴装有多个传感器的头盔,全程无脚本。数据集包含5.5小时立体事件记录,并同步提供RGB、深度与惯性测量单元(IMU)数据。共标注10,762段动作片段与13,482个边界框。我们基于该数据集训练了基础模型,开展动作识别、目标检测与立体深度估计等多项任务。通过捕捉真实世界中的自然人类行为,EventKitchen为神经形态视觉在非自动驾驶场景下的发展提供了挑战性基准。
原文摘要 · Abstract (English)
Event cameras, also known as neuromorphic cameras, have gained significant attention in recent years due to their high temporal resolution, high dynamic range, and low power consumption. While many studies and datasets in neuromorphic vision have focused on automotive and drone applications, human-centric daily-life scenarios remain largely underrepresented, despite their importance for developing and benchmarking event-based perception systems. Moreover, the few existing event-based human activity datasets are typically recorded with scripted human actions, limiting their ability to capture natural human behaviors. In this paper, we introduce EventKitchen, a large-scale stereo event camera benchmark dataset of human cooking activities in the kitchen. EventKitchen is egocentrically collected from 10 participants in 13 diverse kitchens, where the participants wear a helmet with multiple sensors and naturally perform cooking activities, without any scripted actions. EventKitchen comprises 5.5 hours of stereo event recordings with synchronized RGB, depth, and IMU data. We provide human annotations for 10,762 action segments and 13,482 bounding boxes. We train baseline models on EventKitchen to perform multiple event-based tasks, including action recognition, object detection, and stereo depth estimation. By capturing natural, real-world human activities, EventKitchen establishes a challenging benchmark for neuromorphic vision beyond autonomous driving.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。