轻量级模型同时完成驾驶感知三大任务,适合嵌入式部署。
TriLiteNet: Lightweight Model for Multi-Task Visual Perception
- 设计三任务统一网络,通过共享特征降低计算开销。
- 基础版仅235万参数,计算量7.72 GFLOPs,多任务性能达领先水平。
- 极小版仅14万参数,低延迟低功耗,适合车载实时场景。
高效感知模型对高级别驾驶辅助系统(ADAS)至关重要,因其需在真实环境中实现快速处理与响应以保障安全。为满足此类模型的实时执行需求,本文提出TriLiteNet,可同时处理全景驾驶感知中的多项任务。该模型在保证低计算成本的同时优化性能。在BDD100k数据集上的实验表明,TriLiteNet_{base}在车辆检测、可行驶区域分割和车道线分割三项任务中均达到优异表现:车辆检测召回率达85.6%,可行驶区域分割的平均交并比(mIoU)为92.4%,车道线分割准确率为82.3%,且仅需2.35M参数和7.72 GFLOPs计算量。模型还包含一个仅0.14M参数的微型配置,实现极低计算开销的多任务解决方案。在嵌入式设备上评估显示,两种配置均具备低延迟与合理功耗。通过平衡性能、计算效率与可扩展性,TriLiteNet为实际自动驾驶应用提供了可部署的实用方案。代码已开源于https://github.com/chequanghuy/TriLiteNet。
原文摘要 · Abstract (English)
Efficient perception models are essential for Advanced Driver Assistance Systems (ADAS), as these applications require rapid processing and response to ensure safety and effectiveness in real-world environments. To address the real-time execution needs of such perception models, this study introduces the TriLiteNet model. This model can simultaneously manage multiple tasks related to panoramic driving perception. TriLiteNet is designed to optimize performance while maintaining low computational costs. Experimental results on the BDD100k dataset demonstrate that the model achieves competitive performance across three key tasks: vehicle detection, drivable area segmentation, and lane line segmentation. Specifically, the TriLiteNet_{base} demonstrated a recall of 85.6% for vehicle detection, a mean Intersection over Union (mIoU) of 92.4% for drivable area segmentation, and an Acc of 82.3% for lane line segmentation with only 2.35M parameters and a computational cost of 7.72 GFLOPs. Our proposed model includes a tiny configuration with just 0.14M parameters, which provides a multi-task solution with minimal computational demand. Evaluated for latency and power consumption on embedded devices, TriLiteNet in both configurations shows low latency and reasonable power during inference. By balancing performance, computational efficiency, and scalability, TriLiteNet offers a practical and deployable solution for real-world autonomous driving applications. Code is available at https://github.com/chequanghuy/TriLiteNet.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。