轻量级多任务分割模型,兼顾精度与实时性,适合车载系统部署。
TwinMixing: A Shuffle-Aware Feature Interaction Model for Multi-Task Segmentation
- 共享编码器+任务专用解码器,实现特征共享与任务特化。
- 基线配置达92.0% mIoU(可行驶区域)和32.3% IoU(车道),仅0.43M参数。
- 模块化设计简洁高效,适合嵌入式自动驾驶系统实时运行。
精准高效的感知对自动驾驶至关重要,其中可行驶区域与车道分割为路径规划提供关键线索。然而,在低成本硬件上同时实现高精度与实时性仍是难题。为此,本文提出TwinMixing,一种专为可行驶区域与车道分割设计的轻量级多任务分割模型。网络采用共享编码器与任务专用解码器结构,支持特征共享与任务特化。编码器中引入高效金字塔混合(EPM)模块,结合分组卷积、深度可分离膨胀卷积与通道混洗操作,有效扩展感受野并降低计算开销。每个解码器采用双分支上采样(DBU)模块,包含可学习的转置卷积精细分支与无参数双线性插值粗粒度分支,实现细节丰富且空间一致的特征重建。在BDD100K数据集上的大量实验验证了TwinMixing的有效性,三种配置(tiny、base、large)均表现优异。其中基线配置在精度与效率间取得最佳平衡:可行驶区域分割达92.0% mIoU,车道分割达32.3% IoU,仅需0.43M参数与3.95 GFLOPs。相比现有模型,TwinMixing在相同任务上持续领先。其紧凑模块化设计使其具备在自动驾驶与嵌入式感知系统中实时部署的强大潜力。代码已开源:https://github.com/Jun0se7en/TwinMixing。
原文摘要 · Abstract (English)
Accurate and efficient perception is essential for autonomous driving, where segmentation tasks such as drivable-area and lane segmentation provide critical cues for motion planning and control. However, achieving high segmentation accuracy while maintaining real-time performance on low-cost hardware remains a challenging problem. To address this issue, we introduce TwinMixing, a lightweight multi-task segmentation model designed explicitly for drivable-area and lane segmentation. The proposed network features a shared encoder and task-specific decoders, enabling both feature sharing and task specialization. Within the encoder, we propose an Efficient Pyramid Mixing (EPM) module that enhances multi-scale feature extraction through a combination of grouped convolutions, depthwise dilated convolutions and channel shuffle operations, effectively expanding the receptive field while minimizing computational cost. Each decoder adopts a Dual-Branch Upsampling (DBU) Block composed of a learnable transposed convolution-based Fine detailed branch and a parameter-free bilinear interpolation-based Coarse grained branch, achieving detailed yet spatially consistent feature reconstruction. Extensive experiments on the BDD100K dataset validate the effectiveness of TwinMixing across three configurations - tiny, base, and large. Among them, the base configuration achieves the best trade-off between accuracy and computational efficiency, reaching 92.0% mIoU for drivable-area segmentation and 32.3% IoU for lane segmentation with only 0.43M parameters and 3.95 GFLOPs. Moreover, TwinMixing consistently outperforms existing segmentation models on the same tasks, as illustrated in Fig. 1. Thanks to its compact and modular design, TwinMixing demonstrates strong potential for real-time deployment in autonomous driving and embedded perception systems. The source code: https://github.com/Jun0se7en/TwinMixing.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。