arXiv:2605.21007cs.CVcs.RO2026-05被引 1

轻量级多模态网络实现高效道路分割,兼顾精度与实时性。

LiteViLNet: Lightweight Vision-LiDAR Fusion Network for Efficient Road Segmentation

论文配图:LiteViLNet: Lightweight Vision-LiDAR Fusion Network for Efficient Road Segmentation
图 1 · 摘自论文原文
  • 双流轻量化编码器+深度可分离卷积,减少参数量
  • 14.04M参数下达96.36% MaxF,推理速度163.79 FPS
  • 适合边缘设备部署,适用于自动驾驶与机器人

道路分割是自动驾驶与智能机器人系统的核心感知任务,需兼顾高精度与实时推理,尤其在资源受限的嵌入式设备上。现有方法多依赖重型Transformer编码器,计算开销大,难以实现实时部署。为此,我们提出LiteViLNet,一种轻量级多模态网络,融合RGB纹理与LiDAR几何信息实现高效道路分割。设计双流轻量化编码器与深度可分离卷积,以极少参数提取多层级特征;提出多尺度特征融合模块(MSFM)促进跨模态交互,以及大核桥接模块以线性复杂度捕捉长程依赖。在KITTI Road数据集与真实场景中实验表明,仅含14.04M参数的模型取得96.36% MaxF,优于所有CNN基线方法,媲美更大规模Transformer模型,且在RTX 4060 Ti上达到163.79 FPS(Jetson Orin NX上22.18 FPS),显著提升推理速度同时保持高精度,充分验证其在自动驾驶与智能机器人中的实时嵌入式部署潜力。

原文摘要 · Abstract (English)

Road segmentation is a fundamental perception task for autonomous driving and intelligent robotic systems, requiring both high accuracy and real-time inference, especially for deployment on resource-constrained edge devices. Existing multi-modal road segmentation methods often rely on heavy transformer-based encoders to achieve state-of-the-art performance, but their enormous computational cost prohibits real-time deployment on embedded platforms. To address this dilemma, we propose LiteViLNet, a lightweight multi-modal network that fuses RGB texture information and LiDAR geometric information for efficient road segmentation. Specifically, we design a dual-stream lightweight encoder and depth-wise separable convolutions to extract hierarchical features from both modalities with minimal parameters. We further propose a Multi-Scale Feature Fusion Module (MSFM) to facilitate cross-modal interaction at different levels, and a large-kernel-bridge module to capture long-range dependencies with linear complexity. Extensive experiments on the KITTI Road dataset and real-world applications demonstrate that LiteViLNet achieves a promising balance between accuracy and efficiency. Notably, with only 14.04M parameters, our model attains a 96.36% MaxF score, ranking the best among all CNN-based methods and being comparable to larger transformer-based models, and runs at 163.79 FPS in model-only inference on RTX 4060 Ti (22.18 FPS on Jetson Orin NX). It outperforms numerous heavy-weight methods in inference speed while maintaining highly competitive accuracy, fully validating the potential of LiteViLNet for real-time embedded deployment in autonomous driving and intelligent robotics.

道路分割多模态融合轻量化模型边缘部署

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。