arXiv:2606.13910cs.CV2026-06中稿 · the 22nd IEEE Inte…

首个车载鱼眼摄像头乘客监控数据集,助力无人公交感知

PMOF: A Dataset and Benchmark for Passenger Monitoring Using Overhead Fisheye Cameras

论文配图:PMOF: A Dataset and Benchmark for Passenger Monitoring Using Overhead Fisheye Cameras
图 1 · 摘自论文原文
  • 构建移动车辆内顶部鱼眼视角数据集,含19000+标注帧
  • 跨域微调后检测准确率达94.8% AP50,超越静态数据集
  • 适合智能交通、视觉感知与泛化模型研究者使用

自动驾驶无工作人员的公共交通需要可靠的车内乘客监测。然而,车辆内部的感知面临空间狭小、光照变化、运动引起的背景变动、遮挡及视角受限等挑战。为缓解这些空间限制,安装在车顶的鱼眼相机可从单一视角实现全场景覆盖。但现有公开的顶部鱼眼数据集均在静态环境中采集,未包含车辆运动带来的域偏移。为此,我们提出PMOF(Passenger Monitoring using Overhead Fisheye cameras),首个在移动车辆内采集的顶视鱼眼图像公开数据集,包含超过19,000帧人工标注的图像。PMOF提供旋转边界框、跟踪标识和动作标签,支持目标检测、跟踪与动作识别任务。我们使用YOLO26m-obb模型在多种数据集组合配置下对PMOF进行基准测试,采用自定义的旋转感知增强进行跨域微调,在PMOF上达到94.8% AP50,对另一未见域的鱼眼数据集达到96.5% AP50。结果凸显了静态与动态环境间的域差距,并表明引入PMOF能提升检测性能,推动鱼眼人体检测的泛化能力。数据集与代码已公开于https://swermuth.github.io/pmof/。

原文摘要 · Abstract (English)

Autonomous staff-free public transport requires reliable in-vehicle passenger monitoring. However, perception inside moving vehicles is challenged by confined spaces, variable illumination, motion-induced background variation, occlusion, and limited viewpoints. To mitigate these spatial constraints, ceiling-mounted fisheye cameras provide full-scene coverage from a single viewpoint. Yet existing public overhead fisheye datasets are recorded in static environments and do not capture the domain shift introduced by vehicle motion. To fill this gap, we introduce PMOF, Passenger Monitoring using Overhead Fisheye cameras, the first public dataset of top-view fisheye imagery captured inside a moving vehicle, comprising over 19k manually annotated frames. PMOF provides rotated bounding boxes, tracking identifiers, and action labels, supporting object detection, tracking, and action recognition. We benchmark PMOF using YOLO26m-obb models fine-tuned under multiple dataset configurations that combine PMOF with existing overhead fisheye datasets. Cross-domain fine-tuning with custom rotation-aware augmentation achieves 94.8% AP50 on PMOF and 96.5% AP50 on an unseen overhead fisheye dataset from a different domain. Our results highlight the domain gap between static and moving environments and show that incorporating PMOF improves detection performance and advances generalization beyond passenger monitoring to broader fisheye-based person detection tasks. The dataset and code are available at https://swermuth.github.io/pmof/.

乘客监控鱼眼相机数据集目标检测

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。