解决点云状态空间模型的频谱偏差与语义稀释问题
SM3D: Mitigating Spectral Bias and Semantic Dilution in Point Cloud State Space Models
- 引入图引导的高频成分注入,恢复几何结构敏感性
- 在ModelNet40达96.0%准确率,ShapeNetPart达86.5% mIoU
- 适合关注3D点云建模与几何语义一致性的研究者
点云是支撑多种计算机视觉任务的基础三维数据表示。近期,Mamba在三维点云理解中展现出强大潜力。然而,现有方法主要关注点的序列化,忽视了更根本的限制:状态空间模型(SSMs)因其递归结构天然存在频谱低通偏差。在序列化点云中,该偏差会抑制高频几何结构,并在深层中逐步稀释语义判别力。为此,我们提出SM3D,一种兼顾几何保真与语义一致性的频谱感知框架。首先,设计几何频谱补偿器(GSC),通过局部拉普拉斯分析显式注入图引导的高频分量,以恢复结构敏感性。其次,设计语义一致性修正器(SCR),通过频谱感知通道重校准纠正语义漂移。为平衡理论精度与计算效率,SCR采用两种路径:精确拉普拉斯特征分解(SCR-L)与线性复杂度切比雪夫多项式近似(SCR-C)。大量实验表明,SM3D达到领先性能,包括ModelNet40上96.0%准确率与ShapeNetPart上86.5% mIoU,验证其在缓解频谱低通偏差与语义稀释方面的有效性。
原文摘要 · Abstract (English)
Point clouds are a fundamental 3D data representation that underpins various computer vision tasks. Recently, Mamba has demonstrated strong potential for 3D point cloud understanding. However, existing approaches primarily focus on point serialization, overlooking a more fundamental limitation: State Space Models (SSMs) inherently exhibit a spectral low-pass bias arising from their recursive formulation. In serialized point clouds, this bias is particularly detrimental, as it suppresses high-frequency geometric structures and progressively dilutes semantic discriminability across deep layers. To address these limitations, we propose SM3D, a spectral-aware framework designed to jointly preserve geometric fidelity and semantic consistency. First, a Geometric Spectral Compensator (GSC) is introduced to counteract the low-pass bias by explicitly injecting graph-guided high-frequency components through local Laplacian analysis, thereby restoring structural sensitivity. Second, we design a Semantic Coherence Refiner (SCR) to rectify semantic drift through frequency-aware channel recalibration. To balance theoretical precision and computational efficiency, SCR is instantiated via two pathways: an exact Laplacian eigendecomposition (SCR-L) and a linear-complexity Chebyshev polynomial approximation (SCR-C). Extensive experiments demonstrate that SM3D achieves state-of-the-art performance, including 96.0% accuracy on ModelNet40 and 86.5% mIoU on ShapeNetPart, validating its effectiveness in mitigating spectral low-pass bias and semantic dilution (Code: https://github.com/L1277471578/SM3D).
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。