提出OwlSight框架,提升暗光视频人体动作识别准确率
OwlSight: A Robust Illumination Adaptation Framework for Dark Video Human Action Recognition
- 全阶段光照增强,结合时序一致性与亮度自适应模块
- 在ARID1.5和Dark-101上分别提升5.36%和1.72%准确率
- 适合暗光环境下动作识别研究者与智能监控系统开发者
低光环境下的行人动作识别对诸多实际应用至关重要。现有方法在训练阶段未充分挖掘亮度信息,导致性能受限。为此,我们提出受生物启发的OwlSight框架,通过全阶段光照增强与动作分类协同优化,实现精准暗光视频动作识别。具体而言,时间一致性模块(TCM)捕捉浅层时空特征并保持时序连贯性,亮度自适应模块(LAM)根据输入亮度分布动态调节亮度;同时引入反射增强模块(RAM),通过双路径交互最大化光照利用并提升识别效果。此外,我们构建了包含18,310段暗光视频、覆盖101个动作类别的大型数据集Dark-101,显著超越现有数据集(如ARID1.5和Dark-48)。大量实验表明,OwlSight在四个低光动作识别基准上均达到领先性能,在ARID1.5上比之前最佳方法提升5.36%,在Dark-101上提升1.72%,验证了其在复杂暗光环境中的有效性。
原文摘要 · Abstract (English)
Human action recognition in low-light environments is crucial for various real-world applications. However, the existing approaches overlook the full utilization of brightness information throughout the training phase, leading to suboptimal performance. To address this limitation, we propose OwlSight, a biomimetic-inspired framework with whole-stage illumination enhancement to interact with action classification for accurate dark video human action recognition. Specifically, OwlSight incorporates a Time-Consistency Module (TCM) to capture shallow spatiotemporal features meanwhile maintaining temporal coherence, which are then processed by a Luminance Adaptation Module (LAM) to dynamically adjust the brightness based on the input luminance distribution. Furthermore, a Reflect Augmentation Module (RAM) is presented to maximize illumination utilization and simultaneously enhance action recognition via two interactive paths. Additionally, we build Dark-101, a large-scale dataset comprising 18,310 dark videos across 101 action categories, significantly surpassing existing datasets (e.g., ARID1.5 and Dark-48) in scale and diversity. Extensive experiments demonstrate that the proposed OwlSight achieves state-of-the-art performance across four low-light action recognition benchmarks. Notably, it outperforms previous best approaches by 5.36% on ARID1.5 and 1.72% on Dark-101, highlighting its effectiveness in challenging dark environments.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。