低成本头戴式立体视觉系统,支持野外自拍数据大规模采集
Ego-OSCAR: Egocentric Open source Stereo CAptuRe System

- 硬件同步双目相机+6轴IMU,嵌入式编码与实时反馈控制
- 单套成本低于200美元,已收集550小时带动作标注的立体视频
- 适合需要规模化采集自拍数据的研究团队或开源项目
我们提出Ego-OSCAR,一个面向野外自拍数据采集的开源硬件、低成本头戴式立体惯性捕获设备。该系统采用硬件同步的全局快门立体相机与六轴IMU,配备嵌入式Linux单板计算机用于本地视频编码,以及实时微控制器实现用户反馈和看门狗功能。整套物料成本低于每单位200美元,仅使用市售组件和3D打印件。随设备发布完整软件栈(硬件加速录制流水线、IMU采样守护进程、时间同步工具、看门狗固件),并提供由分布式贡献者网络在日常室内环境中采集的约550小时每摄像头的立体视频数据,含同步IMU信息。数据为标注而非原始数据:自由形式动作标注覆盖几乎全部录制时段,使用开放词汇;每会话附带立体校准与逐帧3D手部重建。Ego-OSCAR不追求研究级系统(如Project Aria)的单体精度,而是旨在成为最低成本可接受的众包自拍数据采集基底,降低任何团队大规模采集自拍数据的门槛。所有硬件设计、软件及数据集均已开源。
原文摘要 · Abstract (English)
We present Ego-OSCAR, an open-hardware, low-cost, head-mounted stereo-inertial capture device for egocentric data collection in the wild. EgoOSCAR pairs a hardware-synchronized global-shutter stereo camera with a 6- axis IMU, an embedded Linux SBC for on-device video encoding, and a realtime microcontroller for user feedback and watchdog functions. The complete bill of materials is under USD 200 per unit, using only commercially available components and 3D-printed parts. Alongside the device, we release a complete software stack (hardware-accelerated recording pipeline, IMU sampling daemon, time-synchronization tooling, and watchdog firmware) and roughly 550 hours of egocentric stereo video per camera with synchronized IMU, collected by a distributed contributor network across everyday indoor environments. The release is annotated rather than raw: free-form action captions cover essentially the entire recorded timeline with an open vocabulary, and per-frame 3D hand reconstructions ship alongside per-session stereo calibration. Ego-OSCAR does not aim to match the per-unit fidelity of research-grade systems such as Project Aria; it aims to be the cheapest defensible substrate for crowdsourced egocentric capture, and to lower the activation energy for any team that wants to collect egocentric data at scale. All hardware designs, software, and the dataset are open-sourced
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。