arXiv:2607.23979cs.CV2026-07

通过双分支协同增强,提升小样本轮胎花纹识别精度。

Mutual Modality Trust with Lightweight Reconstruction Regularization for Fine-grained Tire Pattern Recognition

论文配图:Mutual Modality Trust with Lightweight Reconstruction Regularization for Fine-grained Tire Pattern Recognition
图 1 · 摘自论文原文
  • 双分支分别处理胎面与胎纹凹陷特征,实现模态专精
  • 引入互信机制融合特征,显著减少过拟合
  • 轻量重建正则化提升特征稳定性,适合数据少场景

视觉轮胎识别是车辆安全监控、自动驾驶感知和自动化汽车维护的核心技术。现有细粒度轮胎识别方法存在三大缺陷:仅依赖单一视觉源、难以联合建模空间与频率特征以提取细微胎纹纹理、在标注数据有限时易过拟合。本文提出一种轻量级细粒度轮胎花纹识别方法,采用双分支独立推理与增强特征融合结构,分别专注于胎面和胎纹凹陷特征提取。每个分支独立预测,跨分支通过互模态信任(M²T)机制实现特征互补增强。此外,设计频域分层引导模块,利用带通滤波器将特征图分解为高低频成分,实现细粒度跨层特征调制。同时引入轻量重建正则化(LR²),保留特征嵌入中的内在信息,显著提升在少量标注数据下的特征稳定性和识别鲁棒性。我们构建了名为MTire299的表面-凹陷多源数据集,涵盖299类共14795对图像样本。在两个公开轮胎数据集上的大量实验验证了所提算法的优越性与有效性。

原文摘要 · Abstract (English)

Visual tire recognition serves as a core supporting technique for vehicle safety monitoring, autonomous driving perception and automated automotive maintenance. Existing fine-grained tire recognition techniques suffer from three prominent limitations. They tend to depend on only one visual source, lack the capacity to jointly model spatial and frequency cues for minute tread texture extraction, and suffer severe overfitting given limited annotated tire imagery. This paper proposes a lightweight fine-grained tire pattern recognition method incorporating dual-branch independent inference and enhanced feature fusion to boost recognition performance. The framework employs two task-specialized branches dedicated to tire surface and tread indentation, respectively, to extract modality-specific discriminative features. Each branch conducts independent prediction, while cross-branch feature fusion exploits Mutual Modality Trust (M$^2$T) to realize complementary feature enhancement across two modalities. Besides, a frequency-domain hierarchical guidance module is devised, which leverages bandpass filters to decompose feature maps into high- and low-frequency components and enables fine-grained cross-layer feature modulation. Furthermore, a Lightweight Reconstruction Regularization (LR$^2$) is introduced to retain abundant intrinsic information within feature embeddings, substantially improving feature stability and recognition robustness under limited labeled training data. In addition, we establish a surface-indentation multi-source dataset namely MTire299 for fine-grained tire tread recognition, which covers 299 categories with a total of 14795 paired image samples. Extensive experiments conducted on two public tire datasets validate the superiority and efficacy of the proposed algorithm.

细粒度识别多模态融合轻量化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。